[/home/ycchen/BTEC/lm/dev6.lm.detoken, /home/ycchen/BTEC/E_output/dev6.same, /home/ycchen/BTEC/E_output/IWSLT08_BTEC.devset6_IWSLT07_E.output.google2, /home/ycchen/BTEC/E_output/IWSLT08_BTEC.devset6_IWSLT07_E.output.otek, /home/ycchen/BTEC/E_output/IWSLT08_BTEC.devset6_IWSLT07_E.output.yahoo] vs. [/s0/ycchen/IWSLT/temp/dev6/reference0, /s0/ycchen/IWSLT/temp/dev6/reference1, /s0/ycchen/IWSLT/temp/dev6/reference2, /s0/ycchen/IWSLT/temp/dev6/reference3, /s0/ycchen/IWSLT/temp/dev6/reference4, /s0/ycchen/IWSLT/temp/dev6/reference5]: Sentence-by-Sentence Comparison

Sentence 0) BLEU: 0.2329 (0.5/0.2353/0.1875/0.1333) ; 0 (0.4375/0.1333/0.07143/0) ; 0.2329 (0.5/0.2353/0.1875/0.1333) ; 0 (0.3889/0.05882/0/0) ; 0.1458 (0.3684/0.1667/0.1176/0.0625)

Source

��

�b

��

�w�R

��

�饻��

��

�C

��

�b

�a��

�W

��

�C

Ref 0

I'm

looking

for

nice,

quiet

sukiyaki

house.
Would

you

point

one

out

this

map?

Ref 1

I'm

searching

for

nice,

quiet

sukiyaki

house.
Could

you

show

one

this

map?

Ref 2

I'm

trying

find

good,

quiet

sukiyaki

restaurant.
Could

you

indicate

one

this

map?

Ref 3

I'm

trying

find

nice,

quiet

sukiyaki

house.
Can

you

show

one

this

map?

Ref 4

looking

for

nice,

quiet

sukiyaki

house.
Could

you

show

one

this

map?

Ref 5

I'm

looking

for

nice,

quiet

sukiyaki

house.
Can

you

show

one

this

map?

Output 0

looking

for

quiet

Japanese-style

hot

pot

restaurants.

Please

refer

the

map

show

me.

N-grams

looking

for

quiet

Japanese-style

hot

pot

restaurants.

Please

refer

the

map

show

me.

looking

for

quiet

show

I am

looking for

I am looking

for a

I am looking for

am looking

am looking for

am looking for a

looking for a

Output 1

looking

for

quiet

hot

pot

please

refer

the

map

japanese

N-grams

looking

for

quiet

hot

pot

please

refer

the

map

japanese

looking

for

quiet

am looking

am looking for

looking for

Output 2

looking

for

quiet

Japanese-style

hot

pot

restaurants.

Please

refer

the

map

show

me.

N-grams

looking

for

quiet

Japanese-style

hot

pot

restaurants.

Please

refer

the

map

show

me.

looking

for

quiet

show

I am

looking for

I am looking

for a

I am looking for

am looking

am looking for

am looking for a

looking for a

Output 3

finding

quiet

Japanese

type

chafing

dish

store.

Please

point

let

see

the

map.

N-grams

finding

quiet

Japanese

type

chafing

dish

store.

Please

point

let

see

the

map.

quiet

point

I am

Output 4

looking

for

the

peaceful

Japanese

style

hot

pot

shop.

Please

refer

the

map

looked.

N-grams

looking

for

the

peaceful

Japanese

style

hot

pot

shop.

Please

refer

the

map

looked.

looking

for

I am

looking for

I am looking

I am looking for

am looking

am looking for

Sentence 1) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.6/0.25/0/0)

Source

�z

��

�ؤo

�O

�h��

�H

Ref 0

What's

your

size?

Ref 1

What

your

size?

Ref 2

What

size

you

use?

Ref 3

What

size

are

you?

Ref 4

What's

your

size?

Ref 5

What

size

you

wear?

Output 0

How

much

your

size?

N-grams

How	much	is	your	size?
		is	your	size?
		is your
		is your size?
			your size?

Output 1

your

size

how

N-grams

your	size	how	?
your	size

Output 2

Your

size?

N-grams

Your	size?
	size?

Output 3

How

much

your

size

N-grams

How	much	is	your	size	?
		is	your	size
		is your

Output 4

How

many

are

your

size?

N-grams

How	many	are	your	size?
		are	your	size?
			your size?

Sentence 2) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�@��

��

�C

Ref 0

straight.

Ref 1

straight

ahead.

Ref 2

directly

ahead.

Ref 3

Keep

going

straight

ahead.

Ref 4

straight.

Ref 5

Keep

going

straight.

Output 0

Please

have

been

walking.

N-grams

Please

have

been

walking.

Output 1

please

have

N-grams

please

have

Output 2

Please

always

follow.

N-grams

Please

always

follow.

Output 3

Please

have

been

walking.

N-grams

Please

have

been

walking.

Output 4

Please

have

walked.

N-grams

Please

have

walked.

Sentence 3) BLEU: 0 (0.4737/0.1111/0/0) ; 0 (0.3529/0.0625/0/0) ; 0 (0.4737/0.1111/0/0) ; 0 (0.3889/0.1765/0.0625/0) ; 0 (0.4706/0.125/0/0)

Source

��

�Q

�אּ

�P��@

��W

�E�I

�_��

��

�@

�C

�G

��

��Z

�C

��

�z

�K�·�

�F

�藍�_

�C

Ref 0

I'd

switch

flight

one

seven

two

departing

nine

Monday

morning.
I'm

sorry

for

all

the

trouble.

Ref 1

would

switch

flight

one

seven

two

leaving

nine

Monday

morning.
I

sorry

for

all

the

trouble.

Ref 2

I'd

change

flight

one

seven

two

leaving

nine

Monday

morning.
Excuse

for

all

the

hassle.

Ref 3

I'd

change

flight

one

seven

two

departing

nine

Monday

morning.
I

apologize

this

causes

any

trouble.

Ref 4

I'd

change

flight

one

seventy

two

leaving

nine

Monday

morning.
I'm

sorry

for

the

bother.

Ref 5

I'd

change

flight

one

seven

two

leaving

nine

Monday

morning.
I

apologize

for

all

the

trouble.

Output 0

want

read

Monday

morning

o'clock

flight

172

took

off.

sorry

trouble

you.

N-grams

want

read

Monday

morning

o'clock

flight

172

took

off.

sorry

trouble

you.

Monday

flight

sorry

on Monday

am sorry

Output 1

want

monday

172

off

sorry

trouble

you

change

N-grams

want

monday

172

off

sorry

trouble

you

change

sorry

change

am sorry

Output 2

want

read

Monday

morning

o'clock

flight

172

took

off.

sorry

trouble

you.

N-grams

want

read

Monday

morning

o'clock

flight

172

took

off.

sorry

trouble

you.

Monday

flight

sorry

on Monday

am sorry

Output 3

want

change

take

off

9:00

a.m.

Monday

172

services.

Trouble

you

sorry.

N-grams

want

change

take

off

9:00

a.m.

Monday

172

services.

Trouble

you

sorry.

change

Monday

to change

on Monday

to change to

change to

Output 4

want

change

9:00

launching

seven

two

flights.

Put

trouble

you

have

sorry.

N-grams

want

change

9:00

launching

seven

two

flights.

Put

trouble

you

have

sorry.

change

seven

two

to change

seven two

Sentence 4) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.625/0.2857/0/0) ; 0 (0.5/0.2/0/0) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0.4347 (0.7143/0.5/0.4/0.25)

Source

�b

�a�K

��

��]

�Q

��

�F

�C

Ref 0

had

wallet

pickpocketed

the

subway.

Ref 1

wallet

was

stolen

the

subway.

Ref 2

wallet

has

been

stolen

the

subway.

Ref 3

had

wallet

stolen

the

subway.

Ref 4

wallet

was

pickpocketed

the

subway.

Ref 5

pickpocket

stole

wallet

the

subway.

Output 0

the

subway,

wallet

was

stolen.

N-grams

In	the	subway,	wallet	was	stolen.
	the		wallet	was
			wallet was

Output 1

the

subway

wallet

stolen

the

N-grams

in	the	subway	wallet	stolen	is	the	.
in	the		wallet	stolen
in the			wallet stolen

Output 2

the

subway,

wallet

was

stolen.

N-grams

In	the	subway,	wallet	was	stolen.
	the		wallet	was
			wallet was

Output 3

The

purse

stolen

the

subway.

N-grams

The	purse	is	stolen	in	the	subway.
			stolen	in	the	subway.
			stolen in		the subway.
			stolen in the
			stolen in the subway.
				in the
				in the subway.

Output 4

The

wallet

stolen

the

subway.

N-grams

The	wallet	is	stolen	in	the	subway.
	wallet		stolen	in	the	subway.
			stolen in		the subway.
			stolen in the
			stolen in the subway.
				in the
				in the subway.

Sentence 5) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�A

��

�u

�@�I

�C

Ref 0

Make

little

shorter,

please.

Ref 1

Please,

make

bit

shorter.

Ref 2

Shorten

bit,

please.

Ref 3

Make

little

shorter,

please.

Ref 4

Make

little

shorter,

please.

Ref 5

Make

little

shorter,

please.

Output 0

Please

cut

point.

N-grams

Please

cut

point.

Output 1

please

again

N-grams

please

again

Output 2

Please

cut

point.

N-grams

Please

cut

point.

Output 3

Please

trim

1:00

again.

N-grams

Please

trim

1:00

again.

Output 4

Please

again

clip

spot.

N-grams

Please	again	clip	a	spot.
			a

Sentence 6) BLEU: 0 (0.6/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�C

�I��

�C

Ref 0

Speak

slowly,

please.

Ref 1

Please,

speak

slowly.

Ref 2

Talk

slowly,

please.

Ref 3

Speak

little

slowly,

please.

Ref 4

Please

talk

slowly.

Ref 5

Please

speak

slowly.

Output 0

Please

say

little

slow.

N-grams

Please	say	a	little	slow.
Please		a	little
		a little

Output 1

please

say

slow

N-grams

please

say

slow

Output 2

Please

say

little

slow.

N-grams

Please	say	a	little	slow.
Please		a	little
		a little

Output 3

Please

say

slowly

son.

N-grams

Please	say	slowly	son.
Please

Output 4

Please

say

the

slow

spot.

N-grams

Please	say	the	slow	spot.
Please

Sentence 7) BLEU: 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�n

�۰�

��ɨ�

�C

Ref 0

Automatic

car,

please.

Ref 1

Please,

automatic

car.

Ref 2

Automatic

car,

please.

Ref 3

Automatic

transmission,

please.

Ref 4

car

with

automatic

transmission,

please.

Ref 5

automatic

car,

please.

Output 0

would

automatic

transmission

cars.

N-grams

I	would	like	to	automatic	transmission	cars.
				automatic

Output 1

automatic

want

shift

N-grams

i	to	automatic	want	shift	.
		automatic

Output 2

would

automatic

transmission

cars.

N-grams

I	would	like	to	automatic	transmission	cars.
				automatic

Output 3

want

shift

gear

car.

N-grams

I	want	an	au	to	shift	gear	a	car.
		an						car.

Output 4

want

the

automatic

shift

vehicle.

N-grams

I	want	the	automatic	shift	vehicle.
			automatic

Sentence 8) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�z

��d

�C

Ref 0

Take

care.

Ref 1

Please,

take

care.

Ref 2

careful.

Ref 3

Take

care

yourself.

Ref 4

Take

care.

Ref 5

You

take

care

now.

Output 0

wish

you

health.

N-grams

wish

you

health.

Output 1

you

health

N-grams

you

health

Output 2

wish

you

health.

N-grams

wish

you

health.

Output 3

Wishing

you

healthy.

N-grams

Wishing

you

healthy.

Output 4

Wishes

your

health.

N-grams

Wishes

your

health.

Sentence 9) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�F

�C

Ref 0

dropped

spoon.

Ref 1

dropped

spoon.

Ref 2

spoon

has

fallen.

Ref 3

spoon

fell.

Ref 4

dropped

spoon.

Ref 5

have

dropped

spoon.

Output 0

The

spoon

dropped.

N-grams

The	spoon	dropped.
	spoon

Output 1

spoon

the

N-grams

spoon	the	.
spoon

Output 2

Spoon

out.

N-grams

Spoon

out.

Output 3

The

spoon

dropped.

N-grams

The	spoon	dropped.
	spoon

Output 4

The

soupspoon

fell.

N-grams

The	soupspoon	fell.
		fell.

Sentence 10) BLEU: 0 (0.4286/0.07692/0/0) ; 0 (0.3636/0.1/0/0) ; 0 (0.4444/0.125/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4286/0.07692/0/0)

Source

��

�i

�ѤU

��

�n

��

�H

Ref 0

Can

have

two

the

best

seats

available?

Ref 1

Could

have

two

the

best

seats

available?

Ref 2

May

have

two

the

best

places

still

free?

Ref 3

Could

get

two

the

best

seats

you

have

available?

Ref 4

Could

have

two

your

best

seats?

Ref 5

May

have

two

the

best

seats

available?

Output 0

Can

give

the

ticket

which

two

are

left

over

the

best

ticket?

N-grams

Can

give

the

ticket

which

two

are

left

over

the

best

ticket?

Can

the

two

the best

best

Output 1

give

the

remaining

two

the

best

ticket

can

N-grams

give	me	the	remaining	two	the	best	ticket	can	in	?
		the		two	the best
						best

Output 2

Give

the

remaining

two

the

best

ticket

votes?

N-grams

Give	me	the	remaining	two	the	best	ticket	votes?
		the		two	the best
						best

Output 3

Can

give

two

best

ticket

the

remaining

tickets?

N-grams

Can	give	me	two	best	ticket	in	the	remaining	tickets?
Can			two	best			the

Output 4

Can

give

the

ticket

which

two

are

left

over

the

best

ticket?

N-grams

Can

give

the

ticket

which

two

are

left

over

the

best

ticket?

Can

the

two

the best

best

Sentence 11) BLEU: 0 (0.8571/0.3333/0/0) ; 0 (0.375/0.1429/0/0) ; 0 (0.8571/0.3333/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.5556/0.125/0/0)

Source

��

�Q

��

�饻

�H

��

�l��

�C

Ref 0

I'd

send

Japan

airmail.

Ref 1

would

prefer

send

Japan

airmail.

Ref 2

would

dispatch

Japan

air.

Ref 3

would

airmail

Japan.

Ref 4

would

mail

Japan

air.

Ref 5

I'd

send

Japan

via

airmail.

Output 0

want

send

airmail

Japan.

N-grams

I	want	to	send	airmail	to	Japan.
I		to	send	airmail	to	Japan.
		to send			to Japan.

Output 1

want

send

japan

the

mail

N-grams

i	want	to	send	japan	the	mail	.
		to	send			mail
		to send

Output 2

want

send

airmail

Japan.

N-grams

I	want	to	send	airmail	to	Japan.
I		to	send	airmail	to	Japan.
		to send			to Japan.

Output 3

want

the

past

and

originally

send

aviation

mail.

N-grams

I	want	to	in	the	past	and	originally	send	aviation	mail.
I		to						send

Output 4

want

send

the

air

mail

toward

Japan.

N-grams

I	want	to	send	the	air	mail	toward	Japan.
I		to	send			mail		Japan.
		to send

Sentence 12) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�Ѥ�f

��

�H

Ref 0

you

have

any

particular

illnesses?

Ref 1

Are

you

suffering

from

any

particular

illnesses?

Ref 2

Are

you

suffering

from

any

specific

ailments?

Ref 3

you

have

any

specific

diseases?

Ref 4

Have

you

any

particular

illnesses?

Ref 5

you

have

any

specific

illnesses?

Output 0

there

chronic

ailment?

N-grams

there

chronic

ailment?

Output 1

N-grams

Output 2

老毛病have

it?

N-grams

老毛病have

it?

Output 3

there

chronic

ailment?

N-grams

there

chronic

ailment?

Output 4

Has

old

malady?

N-grams

Has

old

malady?

Sentence 13) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�̭�

�S

�H

�C

Ref 0

vacant.

Ref 1

empty.

Ref 2

free.

Ref 3

It's

vacant.

Ref 4

It's

empty.

Ref 5

available.

Output 0

one

inside.

N-grams

one

inside.

Output 1

inside

nobody

N-grams

inside

nobody

Output 2

one

inside.

N-grams

one

inside.

Output 3

Inside

nobody.

N-grams

Inside

nobody.

Output 4

Inside

nobody.

N-grams

Inside

nobody.

Sentence 14) BLEU: 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�H

Ref 0

you

have

red

one?

Ref 1

Would

you

have

red

one?

Ref 2

Have

you

got

red

one?

Ref 3

you

have

red

one?

Ref 4

you

have

any

red?

Ref 5

you

have

one

red?

Output 0

You

have

red?

N-grams

You	have	red?
	have	red?

Output 1

red

N-grams

red	?
red

Output 2

You

have

red?

N-grams

You	have	red?
	have	red?

Output 3

red?

N-grams

BE	red?
	red?

Output 4

Has

red?

N-grams

Has	red?
	red?

Sentence 15) BLEU: 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.6667/0/0/0)

Source

�b

�o��

��

�R

��

�q�@

��

�H

Ref 0

Can

get

opera

ticket

here?

Ref 1

Could

buy

ticket

the

opera

here?

Ref 2

Can

buy

opera

ticket

here?

Ref 3

Can

purchase

opera

ticket

here?

Ref 4

Could

buy

opera

ticket

here?

Ref 5

Can

obtain

opera

ticket

here?

Output 0

Can

buy

opera's

ticket

here?

N-grams

Can	buy	opera's	ticket	in	here?
Can	buy		ticket		here?

Output 1

here

opera

can

buy

ticket

N-grams

here	opera	can	buy	ticket	?
	opera		buy	ticket

Output 2

Here

opera

can

buy

votes?

N-grams

Here	opera	can	buy	votes?
	opera		buy

Output 3

Canning

buy

here

operatic

ticket?

N-grams

Canning	buy	here	is	operatic	of	ticket?
	buy

Output 4

Can

buy

opera's

ticket

here?

N-grams

Can	buy	opera's	ticket	in	here?
Can	buy		ticket		here?

Sentence 16) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2857/0/0/0)

Source

��

�xŦ

��q

��

�s

�H

Ref 0

you

have

any

alcohol

that's

good

for

the

liver?

Ref 1

you

have

any

alcohol

which

good

for

the

liver?

Ref 2

Have

you

got

any

alcohol

that's

beneficial

for

the

liver?

Ref 3

you

have

any

alcohol

that

beneficial

for

the

liver?

Ref 4

you

have

any

alcohol

that

good

for

the

liver?

Ref 5

you

have

any

type

alcohol

that's

good

for

the

liver?

Output 0

What

useful

for

liver

alcohol?

N-grams

What	is	useful	for	liver	alcohol?
	is		for

Output 1

what

liver

the

beneficial

N-grams

what	liver	to	the	beneficial	?
			the	beneficial

Output 2

What

useful

for

liver

alcohol?

N-grams

What	is	useful	for	liver	alcohol?
	is		for

Output 3

What

the

liver

beneficial

wine?

N-grams

What	to	the	liver	beneficial	wine?
		the		beneficial

Output 4

What

has

the

liver

beneficial

liquor?

N-grams

What	has	to	the	liver	beneficial	liquor?
			the		beneficial

Sentence 17) BLEU: 0 (0.55/0.1579/0.05556/0) ; 0 (0.2353/0/0/0) ; 0 (0.55/0.1579/0.05556/0) ; 0 (0.25/0/0/0) ; 0 (0.4/0.07143/0/0)

Source

�p�G

�O

�o��

��

�V

�z

��

�j��
��N�]

�Ϊ�

�ì��N�]

�C

Ref 0

I'd

recommend

either

the

Metropolitan

Museum

the

New

York

Museum.

Ref 1

would

recommend

either

the

Metropolitan

Museum

the

New

York

Museum.

Ref 2

I'd

suggest

either

the

Metropolitan

Museum

the

New

York

Museum.

Ref 3

would

suggest

either

the

Metropolitan

Museum

the

New

York

Museum.

Ref 4

would

recommend

either

the

New

York

Museum

the

Metropolitan

Museum.

Ref 5

recommendation

either

the

Metropolitan

Museum

the

New

York

Museum.

Output 0

this

the

case

recommend

you

the

New

York

Metropolitan

Museum

Art

Museum

Art.

N-grams

this

the

case

recommend

you

the

New

York

Metropolitan

Museum

Art

Museum

Art.

the

recommend

the

New

York

Metropolitan

Museum

the New

Metropolitan Museum

the New York

New York

Output 1

this

the

recommend

you

new

york

museum

art

museum

art

N-grams

this

the

recommend

you

new

york

museum

art

museum

art

the

recommend

Output 2

this

the

case

recommend

you

the

New

York

Metropolitan

Museum

Art

Museum

Art.

N-grams

this

the

case

recommend

you

the

New

York

Metropolitan

Museum

Art

Museum

Art.

the

recommend

the

New

York

Metropolitan

Museum

the New

Metropolitan Museum

the New York

New York

Output 3

this

kind

words

toward

you

recommend

mostly

will

art

museum

art

museum

New

York.

N-grams

this

kind

words

toward

you

recommend

mostly

will

art

museum

art

museum

New

York.

recommend

New

Output 4

recommend

the

metropolis

art

museum

New

York

art

museum

you.

N-grams

recommend

the

metropolis

art

museum

New

York

art

museum

you.

recommend

the

New

York

New York

Sentence 18) BLEU: 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�o

��

�H

Ref 0

How

you

this

one?

Ref 1

you

this

one?

Ref 2

this

one

your

tastes?

Ref 3

What

you

think

this

one?

Ref 4

How's

this

one?

Ref 5

How

about

this

one?

Output 0

This

what

kind

of?

N-grams

This

what

kind

of?

Output 1

how

this

kind

N-grams

how	this	kind	?
	this

Output 2

How

this

kind?

N-grams

How	this	kind?
How	this

Output 3

This

how?

N-grams

This

how?

Output 4

This

what

kind

of?

N-grams

This

what

kind

of?

Sentence 19) BLEU: 0 (0.125/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0.1429/0/0/0)

Source

��

�i

�~��

�y��

��

�C

Ref 0

Two

seats

the

upper

deck,

please.

Ref 1

Please,

two

seats

the

upper

deck.

Ref 2

Two

places

the

upper

deck,

please.

Ref 3

I'll

take

two

seats

the

upper

level,

please.

Ref 4

Two

seats

the

upper

deck,

please.

Ref 5

I'd

two

seats

the

upper

deck,

please.

Output 0

Please

give

two

tickets

outfield

seats.

N-grams

Please	give	me	two	tickets	of	outfield	seats.
			two

Output 1

please

give

ticket

two

outfield

N-grams

please	give	me	ticket	two	outfield	.
				two

Output 2

Please

give

two-seat

ticket

field.

N-grams

Please

give

two-seat

ticket

field.

Output 3

Please

give

two

tickets

outfield

seats.

N-grams

Please	give	me	two	tickets	of	outfield	seats.
			two

Output 4

Please

give

two

outfield

seat's

ticket.

N-grams

Please	give	me	two	outfield	seat's	ticket.
			two

Sentence 20) BLEU: 0 (0.2857/0.1538/0/0) ; 0 (0.25/0.1429/0/0) ; 0.6148 (0.7143/0.6667/0.6/0.5) ; 0 (0.2857/0.1538/0/0) ; 0 (0/0/0/0)

Source

��

�A

�y�L

�K�y

�I��

��

�F��

��

�H

Ref 0

Can

you

offer

something

little

cheaper?

Ref 1

Could

you

offer

something

less

expensive?

Ref 2

you

have

anything

cheaper?

Ref 3

Could

you

show

something

little

less

expensive?

Ref 4

you

have

anything

little

cheaper?

Ref 5

Can

you

offer

anything

little

less

expensive?

Output 0

There

the

thing

little

bit

little

bit

cheap

son

again?

N-grams

There

the

thing

little

bit

little

bit

cheap

son

again?

little

a little

Output 1

slightly

little

the

thing

cheap

again

N-grams

slightly	a	little	the	thing	cheap	again	?
	a	little
	a little

Output 2

Slightly

longer

have

anything

little

cheaper?

N-grams

Slightly	longer	have	anything	a	little	cheaper?
		have	anything	a	little	cheaper?
		have anything		a little
		have anything a			little cheaper?
		have anything a little
			anything a
			anything a little
			anything a little cheaper?
				a little cheaper?

Output 3

There

the

thing

little

bit

little

bit

cheap

son

again?

N-grams

There

the

thing

little

bit

little

bit

cheap

son

again?

little

a little

Output 4

Has

again

slightly

the

cheap

spot

thing?

N-grams

Has

again

slightly

the

cheap

spot

thing?

Sentence 21) BLEU: 0 (0.3/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3/0/0/0) ; 0 (0.2857/0/0/0)

Source

��

�o��

��

�ǯu

�o

�X�h

��

�H

Ref 0

Would

you

send

these

fax?

Ref 1

Could

you

send

these

via

fax?

Ref 2

Could

you

fax

these?

Ref 3

Can

you

fax

these?

Ref 4

Would

you

mind

faxing

these?

Ref 5

Could

you

send

these

fax?

Output 0

Can

use

the

fax

this

send

out

to?

N-grams

Can	use	the	fax	to	this	to	send	out	to?
Can			fax				send

Output 1

fax

can

this

the

send

out

N-grams

fax	can	this	the	send	out	?
fax				send

Output 2

Sent

fax

can

this

go?

N-grams

Sent	by	fax	can	this	go?
	by	fax

Output 3

Can

use

the

fax

this

send

out

to?

N-grams

Can	use	the	fax	to	this	to	send	out	to?
Can			fax				send

Output 4

Can

send

out

this

with

the

facsimile?

N-grams

Can	send	out	this	with	the	facsimile?
Can	send

Sentence 22) BLEU: 1 (1/1/1/1) ; 0 (0.4/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.375/0/0/0) ; 0 (0.4/0.25/0/0)

Source

p�L

��

�ɥ�

�ƪ��

�F

�C

Ref 0

Mr.

Kobayashi

was

promoted

vice

president.

Ref 1

Mr.

Kobayashi

was

promoted

vice

president.

Ref 2

Mr.

Kobayashi

was

advanced

vice

president.

Ref 3

Mr.

Kobayashi

received

promotion

vice

president.

Ref 4

Mr.

Kobayashi

has

been

promoted

vice

president.

Ref 5

Mr.

Kobayashi

was

promoted

vice

president.

Output 0

Mr.

Kobayashi

has

been

promoted

vice

president.

N-grams

Mr.	Kobayashi	has	been	promoted	to	vice	president.
Mr.	Kobayashi	has	been	promoted	to	vice	president.
Mr. Kobayashi		has been		promoted to		vice president.
Mr. Kobayashi has			been promoted		to vice
Mr. Kobayashi has been				promoted to vice
	Kobayashi has		been promoted to
	Kobayashi has been			promoted to vice president.
	Kobayashi has been promoted				to vice president.
		has been promoted
		has been promoted to
			been promoted to vice

Output 1

mr.

promoted

president

N-grams

mr.	promoted	to	president	.
	promoted	to
	promoted to

Output 2

Mr.

Kobayashi

has

been

promoted

vice

president.

N-grams

Mr.	Kobayashi	has	been	promoted	to	vice	president.
Mr.	Kobayashi	has	been	promoted	to	vice	president.
Mr. Kobayashi		has been		promoted to		vice president.
Mr. Kobayashi has			been promoted		to vice
Mr. Kobayashi has been				promoted to vice
	Kobayashi has		been promoted to
	Kobayashi has been			promoted to vice president.
	Kobayashi has been promoted				to vice president.
		has been promoted
		has been promoted to
			been promoted to vice

Output 3

Little

Mr.

Lin

rose

allow

vice-

president.

N-grams

Little	Mr.	Lin	rose	to	allow	vice-	president.
	Mr.			to			president.

Output 4

Xiaolin

gentleman

was

promoted

vice-president.

N-grams

Xiaolin	gentleman	was	promoted	vice-president.
		was	promoted
		was promoted

Sentence 23) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.25/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0.2857/0.1667/0/0)

Source

��

�@

��

��R�S�ܯS

�C

Ref 0

Give

one

carton

Merit

lights.

Ref 1

Give

one

box

Merit

lights.

Ref 2

Give

box

Merit

lights.

Ref 3

I'd

carton

Merit

lights.

Ref 4

One

carton

Merit

lights.

Ref 5

I'd

one

carton

Merit

lights.

Output 0

Please

give

\xE7\x91��\xBA\x97\xE7\x89��\x90\x8A\xE7\x89\xB9.

N-grams

Please	give	me	a	\xE7\x91��\xBA\x97\xE7\x89��\x90\x8A\xE7\x89\xB9.
		me	a
		me a

Output 1

please

give

mary

especially

N-grams

please	give	me	a	mary	especially	.
		me	a
		me a

Output 2

Please

give

a瑪麗特萊特.

N-grams

Please	give	me	a瑪麗特萊特.
		me

Output 3

Please

give

Mary

Lai

especially

especially.

N-grams

Please	give	my	a	Mary	Lai	especially	especially.
			a

Output 4

Please

give

Mary

especially

Wright.

N-grams

Please	give	me	a	Mary	especially	Wright.
		me	a
		me a

Sentence 24) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0/0/0/0)

Source

�b

��

�C

Ref 0

was

waiting

for

plane.

Ref 1

was

waiting

for

the

plane.

Ref 2

was

waiting

for

airplane.

Ref 3

was

waiting

for

plane.

Ref 4

was

waiting

for

plane.

Ref 5

was

waiting

for

plane.

Output 0

waiting

for

airplane.

N-grams

It	is	waiting	for	an	airplane.
		waiting	for	an	airplane.
		waiting for		an airplane.
		waiting for an
		waiting for an airplane.
			for an
			for an airplane.

Output 1

N-grams

Output 2

such

aircraft.

N-grams

such

aircraft.

Output 3

waiting

for

airplane.

N-grams

It	is	waiting	for	an	airplane.
		waiting	for	an	airplane.
		waiting for		an airplane.
		waiting for an
		waiting for an airplane.
			for an
			for an airplane.

Output 4

and

airplanes.

N-grams

and

airplanes.

Sentence 25) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�Ҿr

��

�M

�U�h

��

�H

Ref 0

Could

you

clear

table?

Ref 1

Would

you

clear

the

table?

Ref 2

Can

you

clear

table?

Ref 3

Would

you

mind

clearing

table?

Ref 4

Please

clear

table.

Ref 5

Please,

would

you

clear

table?

Output 0

Please

give

\xE6\x92��\xB8\x8B\xE5\x8E\xBB

it?

N-grams

Please	give	me	\xE6\x92��\xB8\x8B\xE5\x8E\xBB	it?
Please

Output 1

can

N-grams

can

Output 2

Please

give

me撤下去it?

N-grams

Please	give	me撤下去it?
Please

Output 3

Troubling

can

withdraw

for

bottom?

N-grams

Troubling

can

withdraw

for

bottom?

Output 4

The

excuse

can

remove

me?

N-grams

The

excuse

can

remove

me?

Sentence 26) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0)

Source

�Q

��

��k

�C

Ref 0

will

take

about

thirty

minutes.

Ref 1

will

take

approximately

thirty

minutes.

Ref 2

will

take

approximately

half

hour.

Ref 3

will

take

around

thirty

minutes.

Ref 4

will

take

about

half

hour.

Ref 5

will

take

around

half

hour.

Output 0

About

three

ten

minutes.

N-grams

About	three	ten	minutes.
			minutes.

Output 1

three

minutes

N-grams

three

minutes

Output 2

Three

minutes.

N-grams

Three	minutes.
	minutes.

Output 3

Around

minutes.

N-grams

Around	30	minutes.
		minutes.

Output 4

About

three

ten

minutes.

N-grams

About	three	ten	minutes.
			minutes.

Sentence 27) BLEU: 0 (0.6/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.3333/0/0/0)

Source

�D��

��

�C

Ref 0

The

bathroom

dirty.

Ref 1

The

bathroom

unclean.

Ref 2

The

restroom

filthy.

Ref 3

The

bathroom

not

clean.

Ref 4

The

bathroom

needs

cleaning.

Ref 5

The

bathroom

isn't

clean.

Output 0

The

bathtub

very

dirty.

N-grams

The	bathtub	is	very	dirty.
The		is		dirty.

Output 1

dirty

bathtub

very

N-grams

dirty

bathtub

very

Output 2

Dirty

bathtub.

N-grams

Dirty

bathtub.

Output 3

The

bathtub

very

dirty.

N-grams

The	bathtub	is	very	dirty.
The		is		dirty.

Output 4

Bathtub

very

dirty.

N-grams

Bathtub	very	dirty.
		dirty.

Sentence 28) BLEU: 0.8409 (1/0.8333/0.8/0.75) ; 0 (0.625/0.4286/0.1667/0) ; 0.8409 (1/0.8333/0.8/0.75) ; 0 (1/0.6/0.25/0) ; 0 (0.8/0.5/0.3333/0)

Source

��

�A

��

�@�U

��

�H

Ref 0

May

see

the

again?

Ref 1

Could

look

the

again?

Ref 2

Can

have

another

look

the

menu?

Ref 3

Can

look

the

again?

Ref 4

May

look

the

again?

Ref 5

May

take

look

the

again?

Output 0

Can

take

look

the

menu?

N-grams

Can	take	a	look	at	the	menu?
Can	take	a	look	at	the	menu?
	take a		look at		the menu?
	take a look			at the
	take a look at
		a look		at the menu?
		a look at
		a look at the
			look at the
			look at the menu?

Output 1

can

take

look

the

again

N-grams

can	take	a	look	the	menu	again	?
	take	a	look	the	menu
	take a			the menu
	take a look
		a look

Output 2

Can

take

look

the

menu?

N-grams

Can	take	a	look	at	the	menu?
Can	take	a	look	at	the	menu?
	take a		look at		the menu?
	take a look			at the
	take a look at
		a look		at the menu?
		a look at
		a look at the
			look at the
			look at the menu?

Output 3

Can

take

look

again?

N-grams

Can	take	a	look	menu	again?
Can	take	a	look	menu	again?
	take a			menu again?
	take a look
		a look

Output 4

Can

read

the

again?

N-grams

Can	read	the	menu	again?
Can		the	menu	again?
		the menu
		the menu again?
			menu again?

Sentence 29) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.1/0/0/0) ; 0 (0.3333/0/0/0)

Source

�ɤ�

��

��R��

�渨

�F

�C

Ref 0

filling

has

come

out.

Ref 1

filling

has

dropped

out.

Ref 2

One

the

fillings

has

come

out.

Ref 3

filling

has

fallen

out.

Ref 4

filling

came

out.

Ref 5

filling

has

come

out.

Output 0

The

filling

material

fell

off.

N-grams

The	filling	filling	material	fell	off.
	filling

Output 1

fill

off

the

N-grams

fill	a	off	of	the	.
			of	the
			of the

Output 2

Fill

tooth

off

the

filler.

N-grams

Fill	a	tooth	off	of	the	filler.
				of	the
				of the

Output 3

Fill

dental

cavity

filled

thing

shed

off.

N-grams

Fill	dental	cavity	of	filled	a	thing	to	shed	off.
			of

Output 4

The

filling

material

fell

off.

N-grams

The	filling	filling	material	fell	off.
	filling

Sentence 30) BLEU: 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.2857/0/0/0)

Source

��

�@�U

�q��

�C

Ref 0

May

use

your

telephone?

Ref 1

Could

borrow

your

telephone?

Ref 2

Can

use

your

phone?

Ref 3

Could

use

your

phone?

Ref 4

May

use

your

phone?

Ref 5

Could

use

your

telephone?

Output 0

Please

lend

use

telephone.

N-grams

Please	lend	me	to	use	a	telephone.
				use

Output 1

use

please

telephone

N-grams

use	please	me	to	telephone	.
use

Output 2

Requests

phone

use.

N-grams

Requests	by	phone	I	use.
			I

Output 3

Please

lend

use

telephone.

N-grams

Please	lend	me	to	use	a	telephone.
				use

Output 4

Please

borrow

use

the

telephone.

N-grams

Please	borrow	me	to	use	the	telephone.
	borrow			use

Sentence 31) BLEU: 0 (0.375/0/0/0) ; 0 (0/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.2857/0/0/0)

Source

��

�n

��

ù�Ťh

��

�C

Ref 0

May

speak

Mr.

Rogers?

Ref 1

Could

speak

Mr.

Rogers?

Ref 2

Can

talk

Mr.

Rogers?

Ref 3

Could

talk

Mr.

Rogers?

Ref 4

May

talk

Mr.

Rogers?

Ref 5

Mr.

Rogers

available

speak

to?

Output 0

want

find

luo

jia

Mr.

private.

N-grams

I	want	to	find	luo	jia	Mr.	private.
I		to				Mr.

Output 1

find

mr.

luo

jiashi

N-grams

find

mr.

luo

jiashi

Output 2

find

Mr.

Luo

Jiashi.

N-grams

I	find	Mr.	Luo	Jiashi.
I		Mr.

Output 3

want

find

Luo

Jia

Mr.

private.

N-grams

I	want	to	find	Luo	Jia	Mr.	private.
I		to				Mr.

Output 4

must

look

for

Mr.

Luo

Jiashi.

N-grams

I	must	look	for	Mr.	Luo	Jiashi.
I				Mr.

Sentence 32) BLEU: 0 (0.3333/0.2/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.7143/0.5/0.2/0) ; 0 (0.3333/0.2/0/0)

Source

��

�o��

�O

��

�C

�]

��

�H

Ref 0

Mmm,

it's

good.
Do

you

want

try

some

mine?

Ref 1

Mmm,

that's

good.
Would

you

try

some

mine?

Ref 2

Yummy,

it's

great.
Would

you

try

mine?

Ref 3

Mmm,

this

good.
Would

you

try

some?

Ref 4

Mmm,

good.
Do

you

want

taste

mine?

Ref 5

Yum,

it's

good.
Do

you

want

try

some

mine?

Output 0

This

good.

Also

tastes

me?

N-grams

This	is	good.	Also	tastes	me?
	is	good.
	is good.

Output 1

this

good

also

N-grams

this	is	good	also	me	?
this	is
this is

Output 2

this

good.

Also

try

me?

N-grams

Ah	this	is	good.	Also	try	me?
	this	is	good.		try
	this is
	this is good.
		is good.

Output 3

H'm

this

good.

Also

taste

mine?

N-grams

H'm	this	is	good.	Also	taste	mine?
	this	is	good.		taste	mine?
	this is				taste mine?
	this is good.
		is good.

Output 4

This

good.

Also

tastes

me?

N-grams

This	is	good.	Also	tastes	me?
	is	good.
	is good.

Sentence 33) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�b

�a�i

�N

��

�F

�C

Ref 0

The

counter

fine.

Ref 1

The

counter

perfect.

Ref 2

The

counter

okay.

Ref 3

The

counter

fine.

Ref 4

The

counter's

fine.

Ref 5

The

counter

fine.

Output 0

the

bar

there.

N-grams

the

bar

there.

Output 1

the

N-grams

the

Output 2

the

bar

there.

N-grams

the

bar

there.

Output 3

Went

the

buffet.

N-grams

Went

the

buffet.

Output 4

Was

good

Taiwan.

N-grams

Was

good

Taiwan.

Sentence 34) BLEU: 0 (0.6667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (1/1/0.5/0) ; 0 (0.6667/0/0/0) ; 1 (1/1/1/1)

Source

��

�O�o

�F

�C

Ref 0

don't

remember.

Ref 1

don't

recall.

Ref 2

not

recall.

Ref 3

can't

recall.

Ref 4

not

remember.

Ref 5

can

not

recall.

Output 0

didn't

remember.

N-grams

I	didn't	remember.
I		remember.

Output 1

not

remember

N-grams

i	not	remember	.
	not

Output 2

can

not

remember.

N-grams

I	can	not	remember.
I	can	not	remember.
I can		not remember.
I can not
	can not

Output 3

didn't

remember.

N-grams

I	didn't	remember.
I		remember.

Output 4

not

remember.

N-grams

I	do	not	remember.
I	do	not	remember.
I do		not remember.
I do not
I do not remember.
	do not
	do not remember.

Sentence 35) BLEU: 0 (0.375/0.2857/0.1667/0) ; 0 (0.5/0.2/0/0) ; 0 (0.375/0.2857/0.1667/0) ; 0 (0.375/0.2857/0.1667/0) ; 0 (0.08333/0/0/0)

Source

�·�

�z

��

�@

�i

��

�H

Ref 0

Excuse

me.
Can

you

take

picture

us?

Ref 1

Excuse

me.
Could

you

take

photo

us?

Ref 2

Pardon.
Would

you

mind

taking

photo

us?

Ref 3

Pardon

me.
Could

you

take

our

picture?

Ref 4

Pardon

me.
Would

you

take

picture

us?

Ref 5

Excuse

me.
Could

you

take

picture

us?

Output 0

Please

help

take

picture

with

it?

N-grams

Please	help	me	take	a	picture	with	it?
			take	a	picture
			take a
			take a picture
				a picture

Output 1

help

take

you

N-grams

help	me	take	a	you	?
		take	a	you
		take a

Output 2

Please

help

take

picture

with

it?

N-grams

Please	help	me	take	a	picture	with	it?
			take	a	picture
			take a
			take a picture
				a picture

Output 3

Can

bothering

you

take

photograph

for

me?

N-grams

Can	bothering	you	take	a	photograph	for	me?
		you	take	a
		you take
		you take a
			take a

Output 4

troublesome

you

able

help

according

one?

N-grams

Is	troublesome	you	to	be	able	to	help	me	according	to	one?
		you

Sentence 36) BLEU: 0 (0.6667/0.4/0.25/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.1111/0/0/0)

Source

��

�s

�X��

�C

Ref 0

Please

call

taxi.

Ref 1

Please

hail

taxi.

Ref 2

you

mind

calling

cab,

please?

Ref 3

Please

call

cab.

Ref 4

Please

call

for

taxi.

Ref 5

Would

you

please

call

taxi?

Output 0

Please

help

call

taxi.

N-grams

Please	help	me	call	a	taxi.
Please			call	a	taxi.
			call a
			call a taxi.
				a taxi.

Output 1

please

help

call

car

N-grams

please	help	me	call	a	car	.
please			call	a
			call a

Output 2

Please

help

call

taxi.

N-grams

Please	help	me	call	a	taxi.
Please			call	a	taxi.
			call a
			call a taxi.
				a taxi.

Output 3

Please

call

rent

car

for

me.

N-grams

Please	call	a	rent	car	for	me.
Please	call	a			for
Please call
Please call a
	call a

Output 4

Please

help

called

the

rental

car.

N-grams

Please	help	me	to	be	called	the	rental	car.
Please

Sentence 37) BLEU: 0 (0.1667/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.4286/0.3333/0.2/0)

Source

�@

�Z

�O

�X�I

�H

Ref 0

When

the

flight?

Ref 1

When

the

following

flight?

Ref 2

what

time

the

flight?

Ref 3

When

does

the

flight

leave?

Ref 4

What

time

the

flight?

Ref 5

When

the

flight?

Output 0

The

are

few

points?

N-grams

The	next	are	a	few	points?
	next

Output 1

the

N-grams

the	next	is	?
the	next	is
the next

Output 2

The

are

few

points?

N-grams

The	next	are	a	few	points?
	next

Output 3

what

time?

N-grams

Next	is	what	time?
	is	what

Output 4

How

many

spots

the

class?

N-grams

How	many	spots	is	the	next	class?
			is	the	next
			is the
			is the next
				the next

Sentence 38) BLEU: 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

�O

��k�ӷ

��

�H

Ref 0

this

Alpha

Inc.?

Ref 1

this

Alpha

Inc.?

Ref 2

Would

this

Alpha

Inc.?

Ref 3

this

Alpha

Inc.?

Ref 4

this

Alpha

Incorporated?

Ref 5

Could

you

tell

this

Alpha

Inc.?

Output 0

the

alpha

chamber

commerce?

N-grams

Is	the	alpha	chamber	of	commerce?
Is

Output 1

chamber

commerce

alpha

N-grams

chamber

commerce

alpha

Output 2

Chamber

Commerce

Alpha

are

you?

N-grams

Chamber	of	Commerce	Alpha	are	you?
			Alpha

Output 3

method

board

trade?

N-grams

method

board

trade?

Output 4

the

alpha

chamber

commerce?

N-grams

Is	the	alpha	chamber	of	commerce?
Is

Sentence 39) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�F

�C

Ref 0

I'm

dying

thirst.

Ref 1

very

thirsty.

Ref 2

I'm

dying

thirst.

Ref 3

completely

parched.

Ref 4

I'm

thirsty.

Ref 5

I'm

extremely

thirsty.

Output 0

渴死

the

fast.

N-grams

渴死

the

fast.

Output 1

fast

N-grams

fast

Output 2

渴死the

fast.

N-grams

渴死the

fast.

Output 3

Fast

thirsty

die.

N-grams

Fast

thirsty

die.

Output 4

Died

thirst

quickly.

N-grams

Died	of	thirst	quickly.
	of

Sentence 40) BLEU: 0 (0.4/0.1111/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.4/0.1111/0/0) ; 0 (0.375/0.1429/0/0)

Source

�z

�O

�b

�o��

��\

�٬O

�a��

�H

Ref 0

that

for

here

go?

Ref 1

that

for

here

take

out?

Ref 2

that

eat

take

away?

Ref 3

you

want

have

that

here

take

out?

Ref 4

that

stay

go?

Ref 5

you

want

that

for

here

go?

Output 0

you

have

meal

still

keep

taking

here?

N-grams

Do	you	have	a	meal	to	still	keep	taking	here?
Do	you	have			to
Do you

Output 1

you

are

here

N-grams

you	are	here	or	to	?
you		here	or	to
		here or
		here or to
			or to

Output 2

You

are

dining

here

go?

N-grams

You	are	dining	here	or	to	go?
			here	or	to	go?
			here or		to go?
			here or to
			here or to go?
				or to
				or to go?

Output 3

you

have

meal

still

keep

taking

here?

N-grams

Do	you	have	a	meal	to	still	keep	taking	here?
Do	you	have			to
Do you

Output 4

You

are

dine

here

carry

off?

N-grams

You	are	dine	in	here	or	carry	off?
			in	here	or
				here or

Sentence 41) BLEU: 0 (0.3/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�T

��

�p��

��k

��

�n�n

��

�@�U

��

�a��

��

�H

Ref 0

there

any

fun

way

kill

three

hours?

Ref 1

there

any

fun

way

occupy

three

hours?

Ref 2

there

entertaining

way

spend

three

hours?

Ref 3

there

any

amusing

way

spend

three

hours?

Ref 4

there

any

fun

way

while

away

three

hours?

Ref 5

What

fun

way

kill

three

hours?

Output 0

About

hours

have

fun

good

place?

N-grams

About	3	hours	to	have	fun	like	a	good	place?
			to		fun		a

Output 1

about

hours

good

place

three

can

N-grams

about	hours	a	good	place	three	can	?
		a			three

Output 2

About

hours

have

fun

good

place?

N-grams

About	3	hours	to	have	fun	like	a	good	place?
			to		fun		a

Output 3

Three

around

hours

can

well

play

while

place?

N-grams

Three	around	hours	can	well	play	a	while	of	place?
						a	while

Output 4

About

three

hours

can

the

good

amusing

place?

N-grams

About	three	hours	can	the	good	amusing	place?
	three					amusing

Sentence 42) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4286/0.3333/0.2/0) ; 0 (0.2/0/0/0)

Source

��

�ֳf��

�b

��

�H

Ref 0

Where's

the

nearest

leather

shop?

Ref 1

Where

the

closest

leather

shop?

Ref 2

Where

the

closest

leather

boutique?

Ref 3

Where's

the

closest

leather

shop?

Ref 4

Where's

the

closest

leather

boutique?

Ref 5

Where's

the

nearest

shop

that

sells

leather

goods?

Output 0

Where

the

recent

furs

store?

N-grams

Where	is	the	recent	furs	store?
Where	is	the
Where is
Where is the
	is the

Output 1

recent

shop

where

N-grams

recent	shop	where	?
	shop

Output 2

Recent

fur

shop

where?

N-grams

Recent	fur	shop	where?
		shop

Output 3

Where

the

recent

furs

store

N-grams

Where	is	the	recent	furs	store	?
Where	is	the
Where is
Where is the
	is the

Output 4

Recently

furriery

shop

where?

N-grams

Recently	furriery	shop	in	where?
		shop

Sentence 43) BLEU: 0 (0.4/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0/0/0/0)

Source

�X�I

��

�i�H

�O

�H

Ref 0

What

time

available?

Ref 1

Which

times

are

available?

Ref 2

What

appointment

times

are

free?

Ref 3

What

time

you

have

open?

Ref 4

What

time

slots

are

available?

Ref 5

What

time

you

have

available?

Output 0

What

time

words

can?

N-grams

What	time	of	words	can?
What	time
What time

Output 1

words

can

N-grams

words

can

Output 2

Some

words

can?

N-grams

Some

words

can?

Output 3

What

time

words

can?

N-grams

What	time	of	words	can?
What	time
What time

Output 4

How

many

spot

words

can?

N-grams

How

many

spot

words

can?

Sentence 44) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.3333/0/0/0)

Source

��

�H

Ref 0

there

shortcut?

Ref 1

there

shortcut?

Ref 2

there

shorter

route?

Ref 3

there

faster

way

get

there?

Ref 4

there

shortcut?

Ref 5

there

shortcut?

Output 0

there

short

cut?

N-grams

Is	there	short	cut?
Is	there
Is there

Output 1

shortcut

has

N-grams

shortcut

has

Output 2

Shortcut

has

it?

N-grams

Shortcut

has

it?

Output 3

there

short

cut?

N-grams

Is	there	short	cut?
Is	there
Is there

Output 4

Has

the

shortcut?

N-grams

Has	the	shortcut?
		shortcut?

Sentence 45) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.5/0.3333/0) ; 1 (1/1/1/1) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.25/0/0/0)

Source

��

�y��

�b

��

�H

Ref 0

Where

seat?

Ref 1

Where

seat

located?

Ref 2

Where

place?

Ref 3

Where

seat?

Ref 4

Where

sit?

Ref 5

Where

seat?

Output 0

Where

seat?

N-grams

Where	is	my	seat?
Where	is	my	seat?
Where is		my seat?
Where is my
Where is my seat?
	is my
	is my seat?

Output 1

where

seat

N-grams

where	is	my	seat	?
	is	my	seat
	is my
	is my seat
		my seat

Output 2

Where

seat?

N-grams

Where	is	my	seat?
Where	is	my	seat?
Where is		my seat?
Where is my
Where is my seat?
	is my
	is my seat?

Output 3

Where

seat

N-grams

Where	is	my	seat	?
Where	is	my	seat
Where is		my seat
Where is my
Where is my seat
	is my
	is my seat

Output 4

seat

where?

N-grams

My	seat	in	where?
	seat

Sentence 46) BLEU: 0 (0.2857/0.1667/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.2857/0.1667/0/0)

Source

��I

��

�g��

�F

��

�H

Ref 0

Don't

look

bit

plain?

Ref 1

Don't

look

little

plain?

Ref 2

appear

little

plain?

Ref 3

Don't

look

bit

ordinary?

Ref 4

Don't

look

somewhat

plain?

Ref 5

Don't

you

think

look

bit

plain?

Output 0

don't

having

little

too

rustic?

N-grams

Is	don't	having	a	little	too	rustic?
			a	little
			a little

Output 1

not

too

rustic

little

N-grams

not	a	too	rustic	little	?
	a			little

Output 2

Not

bit

too

rustic

it?

N-grams

Not	a	bit	too	rustic	it?
	a	bit
	a bit

Output 3

don't

having

little

too

rustic?

N-grams

Is	don't	having	a	little	too	rustic?
			a	little
			a little

Output 4

Has

been

not

little

too

rustic?

N-grams

Has	been	not	a	little	too	rustic?
			a	little
			a little

Sentence 47) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0/0/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�n

�I��

�C

Ref 0

I'd

order,

please.

Ref 1

would

make

order,

please.

Ref 2

want

place

order,

please.

Ref 3

would

place

order,

please.

Ref 4

I'm

ready

order,

please.

Ref 5

I'd

place

order,

please.

Output 0

would

order.

N-grams

I	would	like	to	order.
I	would	like	to
I would		like to
I would like
I would like to
	would like
	would like to

Output 1

order

N-grams

order

Output 2

would

order.

N-grams

I	would	like	to	order.
I	would	like	to
I would		like to
I would like
I would like to
	would like
	would like to

Output 3

important

point

vegetables.

N-grams

important

point

vegetables.

Output 4

must

order

food.

N-grams

I	must	order	food.
I

Sentence 48) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0)

Source

��

�C

Ref 0

Thank

you.

Ref 1

Thanks.

Ref 2

Cheers.

Ref 3

Thank

you.

Ref 4

Thank

you.

Ref 5

Thank

you.

Output 0

Thanks.

N-grams

Thanks.

Output 1

N-grams

Output 2

謝謝.

N-grams

謝謝.

Output 3

Thank.

N-grams

Thank.

Output 4

Thanks.

N-grams

Thanks.

Sentence 49) BLEU: 0 (0.3/0.1111/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3/0.1111/0/0)

Source

��

�i

�G

�Q

�E

��

�l��

�C

Ref 0

Five

twenty-nine

cent

stamps,

please.

Ref 1

Five

twenty-nine

cent

stamps,

please.

Ref 2

Can

have

five

twenty-nine

cent

postage

stamps,

please.

Ref 3

Could

have

five

twenty-nine

cent

stamps,

please.

Ref 4

I'd

five

twenty-nine

cent

stamps,

please.

Ref 5

I'd

get

five

twenty-nine

cent

stamps,

please.

Output 0

Please

give

five

two

ten

nine

cent

postage

stamps.

N-grams

Please	give	me	five	two	ten	nine	cent	postage	stamps.
			five				cent	postage
							cent postage

Output 1

please

give

five

stamps

N-grams

please	give	me	five	stamps	.
			five

Output 2

Please

give

five

29-cent

stamps.

N-grams

Please	give	me	five	29-cent	stamps.
			five

Output 3

Please

give

beautiful

cents

5s'

stamp.

N-grams

Please

give

beautiful

cents

5s'

stamp.

Output 4

Please

give

five

two

ten

nine

cent

postage

stamps.

N-grams

Please	give	me	five	two	ten	nine	cent	postage	stamps.
			five				cent	postage
							cent postage

Sentence 50) BLEU: 0 (0.07143/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.07143/0/0/0) ; 0 (0/0/0/0)

Source

��

�g��

�W�P

�ӫ~

��

�ө��

��

�H

Ref 0

Are

there

exclusive

shops

which

sell

world-famous

brands?

Ref 1

Are

there

any

exclusive

shops

which

sell

international

brands?

Ref 2

Are

there

special

outlets

which

sell

internationally

renowned

makes?

Ref 3

Are

there

high-end

shops

which

sell

internationally-known

brands?

Ref 4

Are

there

exclusive

shops

selling

world-famous

brands?

Ref 5

Are

there

any

exclusive

shops

that

sell

world-famous

brands?

Output 0

there

the

deluxe

store

street

the

merchandise

the

management

famous

brand?

N-grams

there

the

deluxe

store

street

the

merchandise

the

management

famous

brand?

there

Output 1

merchandise

has

the

street

store

management

brand

N-grams

merchandise

has

the

street

store

management

brand

Output 2

Brand-name

merchandise

has

operated

the

High

Street

store

it?

N-grams

Brand-name

merchandise

has

operated

the

High

Street

store

it?

Output 3

there

the

deluxe

store

street

the

merchandise

the

management

famous

brand?

N-grams

there

the

deluxe

store

street

the

merchandise

the

management

famous

brand?

there

Output 4

Has

the

management

name

brand

commodity

Exclusive

shop

street?

N-grams

Has

the

management

name

brand

commodity

Exclusive

shop

street?

Sentence 51) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�װ�

�C

Ref 0

here

vacation.

Ref 1

here

vacation.

Ref 2

here

holiday.

Ref 3

I'm

here

holiday.

Ref 4

I'm

here

for

vacation.

Ref 5

here

for

vacation.

Output 0

spend

holiday.

N-grams

To	spend	a	holiday.
		a	holiday.

Output 1

vacation

N-grams

vacation

Output 2

vacation.

N-grams

To	vacation.
	vacation.

Output 3

spend

holiday.

N-grams

To	spend	a	holiday.
		a	holiday.

Output 4

Takes

vacation.

N-grams

Takes	vacation.
	vacation.

Sentence 52) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.6667/0.2/0/0) ; 0 (0.6667/0.5/0/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.2857/0/0/0)

Source

�q

�Q��

�}�l

�o�N

�C

Ref 0

I've

had

fever

since

yesterday.

Ref 1

have

had

fever

since

yesterday.

Ref 2

have

had

temperature

since

yesterday.

Ref 3

have

had

high

temperature

since

yesterday.

Ref 4

I've

had

temperature

since

yesterday.

Ref 5

I've

had

high

temperature

since

yesterday.

Output 0

Have

got

fever

since

yesterday.

N-grams

Have	got	a	fever	since	yesterday.
		a	fever	since	yesterday.
		a fever		since yesterday.
		a fever since
		a fever since yesterday.
			fever since
			fever since yesterday.

Output 1

fever

since

yesterday

have

N-grams

fever	since	yesterday	have	a	.
fever	since		have	a
fever since

Output 2

Fever

since

yesterday.

N-grams

Fever	since	yesterday.
	since	yesterday.
	since yesterday.

Output 3

Have

got

fever

since

yesterday.

N-grams

Have	got	a	fever	since	yesterday.
		a	fever	since	yesterday.
		a fever		since yesterday.
		a fever since
		a fever since yesterday.
			fever since
			fever since yesterday.

Output 4

Started

from

yesterday

have

fever.

N-grams

Started	from	yesterday	to	have	a	fever.
				have	a

Sentence 53) BLEU: 0 (0.4286/0.3333/0.2/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.4286/0.3333/0.2/0) ; 0 (0.6/0.5/0.3333/0)

Source

��

�i�D

��

��B

�C

Ref 0

Could

you

tell

the

total

amount?

Ref 1

Can

you

tell

the

total

amount?

Ref 2

What

the

total

amount?

Ref 3

Can

you

tell

what

the

total

is?

Ref 4

What

the

total

amount,?

Ref 5

What

the

final

total?

Output 0

Please

tell

the

amount

money.

N-grams

Please	tell	me	the	amount	of	money.
	tell	me	the
	tell me
	tell me the
		me the

Output 1

please

tell

the

amount

N-grams

please	tell	me	the	amount	.
	tell	me	the
	tell me
	tell me the
		me the

Output 2

Please

tell

the

amount.

N-grams

Please	tell	me	the	amount.
	tell	me	the
	tell me
	tell me the
		me the

Output 3

Please

tell

the

amount

money.

N-grams

Please	tell	me	the	amount	of	money.
	tell	me	the
	tell me
	tell me the
		me the

Output 4

Please

tell

the

amount.

N-grams

Please	tell	me	the	amount.
	tell	me	the
	tell me
	tell me the
		me the

Sentence 54) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�b

�Q

��

�s��

��

�C

Ref 0

May

speak

Mr.

Yamada,

please?
He's

staying

your

hotel.

Ref 1

Please,

could

speak

Mr.

Yamada.
He's

staying

your

hotel.

Ref 2

Can

speak

Mr.

Yamada,

please?
He

residing

your

hotel.

Ref 3

Could

please

speak

Mr.

Yamada?
He

has

room

your

hotel.

Ref 4

I'd

speak

Mr.

Yamada,

please.
He's

staying

this

hotel.

Ref 5

May

speak

Mr.

Yamada,

please?
He's

guest

your

hotel.

Output 0

find

living

expensive

hotels,

Mr.

Yamada.

N-grams

I	find	living	in	expensive	hotels,	Mr.	Yamada.
I			in			Mr.	Yamada.
						Mr. Yamada.

Output 1

find

expensive

hotel

N-grams

i	find	in	expensive	hotel	.
		in

Output 2

find

living

expensive

hotels,

Mr.

Yamada.

N-grams

I	find	living	in	expensive	hotels,	Mr.	Yamada.
I			in			Mr.	Yamada.
						Mr. Yamada.

Output 3

find

the

expensive

hotel

mountain

farmland

Sir.

N-grams

I	find	in	the	expensive	hotel	of	mountain	farmland	Sir.
I		in

Output 4

look

expensive

hotel

hillside

fields

gentleman.

N-grams

I	look	in	expensive	hotel	hillside	fields	gentleman.
I		in

Sentence 55) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�Q

�ɥ�

�@�U

�Z��

�C

Ref 0

May

use

your

rest

room?

Ref 1

Could

use

your

bathroom?

Ref 2

Can

use

your

bathroom?

Ref 3

Could

use

your

rest

room?

Ref 4

May

use

the

rest

room?

Ref 5

May

use

your

bathroom?

Output 0

want

use

toilet.

N-grams

I	want	to	use	a	toilet.
I			use

Output 1

borrow

toilet

want

N-grams

borrow

toilet

want

Output 2

would

borrow

some

toilet.

N-grams

I	would	like	to	borrow	some	toilet.
I

Output 3

want

use

toilet.

N-grams

I	want	to	use	a	toilet.
I			use

Output 4

want

borrow

the

restroom.

N-grams

I	want	to	borrow	the	restroom.
I				the

Sentence 56) BLEU: 0 (0.3333/0.2/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.1429/0/0/0)

Source

��

�b

��

�R��

�O

�H

Ref 0

Where

can

buy

film?

Ref 1

Where

could

buy

film?

Ref 2

Where

can

purchase

film?

Ref 3

Where

could

purchase

film?

Ref 4

Where

can

get

film?

Ref 5

Where

should

buy

film?

Output 0

Where

can

the

gum

volume

buy?

N-grams

Where	can	the	gum	volume	buy?
Where	can
Where can

Output 1

film

where

can

buy

the

N-grams

film	where	can	buy	the	?
		can	buy

Output 2

Film

where

can

buy?

N-grams

Film	where	it	can	buy?
			can

Output 3

Where

can

the

gum

volume

buy?

N-grams

Where	can	the	gum	volume	buy?
Where	can
Where can

Output 4

Can

the

roll

film

buy

where?

N-grams

Can	the	roll	film	buy	in	where?
				buy

Sentence 57) BLEU: 0 (0.2222/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.375/0/0/0)

Source

��

�M

�o��

�@��

��

�v��

�C

Ref 0

I'd

hair

this.

Ref 1

would

have

hair

this.

Ref 2

would

this

hairstyle.

Ref 3

would

hair

look

this.

Ref 4

would

hair

done

this

way.

Ref 5

I'd

hair

styled

this.

Output 0

Please

give

and

the

same

hairstyle.

N-grams

Please	give	me	to	do	and	the	same	hairstyle.
			to					hairstyle.

Output 1

please

same

hairstyle

this

N-grams

please	me	to	do	same	hairstyle	this	.
		to				this

Output 2

Please

give

and

the

same

hairstyle.

N-grams

Please	give	me	to	do	and	the	same	hairstyle.
			to					hairstyle.

Output 3

Please

similar

this

hair

style

for

me.

N-grams

Please	do	similar	to	this	hair	style	for	me.
			to	this	hair

Output 4

Please

with

this

same

hairstyle.

N-grams

Please	do	to	me	with	this	same	hairstyle.
		to			this		hairstyle.

Sentence 58) BLEU: 0 (0.1111/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1111/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�\

��

�I

Ref 0

Shut

and

gimme

your

money.

Ref 1

Shut

and

hand

over

your

money.

Ref 2

Silence

and

hand

over

your

cash.

Ref 3

Shut

your

mouth

and

hand

over

your

money.

Ref 4

Shut

and

hand

over

all

your

money.

Ref 5

Shut

up,

just

give

your

money.

Output 0

Not

allowed

put

some

money

shout!

N-grams

Not	allowed	to	put	up	some	money	to	shout!
				up

Output 1

money

shout

N-grams

money

shout

Output 2

Not

allowed

put

some

money

shout!

N-grams

Not	allowed	to	put	up	some	money	to	shout!
				up

Output 3

Forbid

shout

take

money!

N-grams

Forbid

shout

take

money!

Output 4

Cannot

shout

that

draws

cash!

N-grams

Cannot

shout

that

draws

cash!

Sentence 59) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�S

��

�C

Ref 0

I'm

waiting

for

change.

Ref 1

I'm

waiting

for

the

change.

Ref 2

waiting

for

the

change.

Ref 3

waiting

for

change.

Ref 4

I'm

waiting

for

change.

Ref 5

I'm

waiting

get

change.

Output 0

Haven't

returned

change

for

me.

N-grams

Haven't	returned	change	for	me.
			for

Output 1

not

money

change

N-grams

not

money

change

Output 2

Not

give

money.

N-grams

Not

give

money.

Output 3

Haven't

returned

change

for

me.

N-grams

Haven't	returned	change	for	me.
			for

Output 4

Has

not

given

change

get

money

me.

N-grams

Has	not	given	change	get	money	to	me.
				get		to

Sentence 60) BLEU: 0 (0.125/0/0/0) ; 0 (0/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.2222/0/0/0)

Source

��

��D

�F

�C

�H

��

�n

�O

�H

Ref 0

Right.
Where

shall

post

it?

Ref 1

Okay.
Where

should

post

it?

Ref 2

Okay.
Where

shall

mail

it?

Ref 3

Okay.
Where

shall

send

it?

Ref 4

Right.
Where

should

mail

it?

Ref 5

Okay.
Where

shall

mail

to?

Output 0

know.

Letter

goes

where

good?

N-grams

I	know.	Letter	goes	to	where	is	good?
I

Output 1

letter

where

knew

the

N-grams

letter

where

knew

the

Output 2

know.

Letter

goes

where

good?

N-grams

I	know.	Letter	goes	to	where	is	good?
I

Output 3

knew.

The

letter

throws

where

like?

N-grams

I	knew.	The	letter	throws	where	like?
I

Output 4

knew.

Where

does

the

letter

throw

well

to?

N-grams

I	knew.	Where	does	the	letter	throw	well	to?
I								to?

Sentence 61) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6/0.5/0.3333/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6/0.5/0.3333/0) ; 0.5081 (0.6667/0.6/0.5/0.3333)

Source

�b

�ھ�

�X

�F

��q

�ƬG

�C

Ref 0

was

involved

traffic

accident

Paris.

Ref 1

was

traffic

accident

Paris.

Ref 2

While

Paris,

had

traffic

accident.

Ref 3

got

into

car

accident

Paris.

Ref 4

had

traffic

accident

Paris.

Ref 5

was

involved

automobile

accident

Paris.

Output 0

traffic

accident

Paris.

N-grams

A	traffic	accident	in	Paris.
	traffic	accident	in	Paris.
	traffic accident		in Paris.
	traffic accident in
	traffic accident in Paris.
		accident in
		accident in Paris.

Output 1

traffic

accident

paris

N-grams

traffic	accident	in	paris	.
traffic	accident	in
traffic accident
traffic accident in
	accident in

Output 2

traffic

accident

Paris.

N-grams

A	traffic	accident	in	Paris.
	traffic	accident	in	Paris.
	traffic accident		in Paris.
	traffic accident in
	traffic accident in Paris.
		accident in
		accident in Paris.

Output 3

Paid

transportation

accident

Paris.

N-grams

Paid	transportation	accident	in	Paris.
		accident	in	Paris.
		accident in
		accident in Paris.
			in Paris.

Output 4

Had

the

traffic

accident

Paris.

N-grams

Had	the	traffic	accident	in	Paris.
		traffic	accident	in	Paris.
		traffic accident		in Paris.
		traffic accident in
		traffic accident in Paris.
			accident in
			accident in Paris.

Sentence 62) BLEU: 0 (0.75/0.4286/0.1667/0) ; 0 (0.4286/0.1667/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.6667/0.375/0.1429/0)

Source

��

�a

��

�h

��

�C

Ref 0

Please

take

the

hospital.

Ref 1

Please

transport

the

hospital.

Ref 2

Please

drive

the

hospital.

Ref 3

Please

get

hospital.

Ref 4

Please

get

the

hospital.

Ref 5

Would

you

take

the

hospital,

please?

Output 0

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please		me	to		to a		hospital.
		me to			to a hospital.
						a
						a hospital.

Output 1

please

hospital

N-grams

please	me	to	hospital	go	to	.
	me	to
	me to

Output 2

Please

take

hospital.

N-grams

Please	take	me	to	hospital.
Please	take	me	to	hospital.
Please take		me to
Please take me
Please take me to
	take me
	take me to

Output 3

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please		me	to		to a		hospital.
		me to			to a hospital.
						a
						a hospital.

Output 4

Invites

lead

the

hospital.

N-grams

Invites	to	lead	me	to	go	to	the	hospital.
	to		me			to the		hospital.
			me to			to the hospital.
							the
							the hospital.

Sentence 63) BLEU: 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0)

Source

�G

�h

�C

Ref 0

stomach

aches.

Ref 1

stomach

aches.

Ref 2

suffering

from

stomach

ache.

Ref 3

have

pains

stomach.

Ref 4

stomach

hurts.

Ref 5

have

stomach

ache.

Output 0

Stomach

ache.

N-grams

Stomach	ache.
	ache.

Output 1

stomach

N-grams

stomach	.
stomach

Output 2

Stomach.

N-grams

Stomach.

Output 3

Have

stomach-ache.

N-grams

Have	a	stomach-ache.
	a

Output 4

Stomach

ache.

N-grams

Stomach	ache.
	ache.

Sentence 64) BLEU: 0 (0.5/0.2/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.2/0/0/0)

Source

��

�A

�K�y

�I

��

�H

Ref 0

Can't

you

make

little

cheaper?

Ref 1

Couldn't

you

make

bit

cheaper?

Ref 2

Couldn't

you

make

cheaper?

Ref 3

Can't

you

lower

the

price?

Ref 4

Can't

you

make

bit

cheaper?

Ref 5

Can't

you

bring

down

the

price

little?

Output 0

Ability

again

little

bit

cheap?

N-grams

Ability	again	a	little	bit	cheap?
		a	little	bit
		a little

Output 1

cheap

can

again

N-grams

cheap

can

again

Output 2

Cheap

points

can

it?

N-grams

Cheap

points

can

it?

Output 3

Ability

again

little

bit

cheap?

N-grams

Ability	again	a	little	bit	cheap?
		a	little	bit
		a little

Output 4

Can

again

the

cheap

spot?

N-grams

Can	again	the	cheap	spot?
		the

Sentence 65) BLEU: 0 (0.1818/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.1818/0/0/0) ; 0 (0.3333/0/0/0)

Source

�[��

�ݸ߳B

�b

��

�H

Ref 0

Where

the

tourist

information

center?

Ref 1

Where

the

tourist

information

center?

Ref 2

Where

can

find

the

tourist

information

office?

Ref 3

Where

can

find

the

tourist

information

center?

Ref 4

Where's

the

tourist

information

center?

Ref 5

Where

the

tourist

information

office?

Output 0

Where

does

the

sightseeing

ask

inquire

placed

in?

N-grams

Where	does	the	sightseeing	ask	to	inquire	to	be	placed	in?
Where		the

Output 1

where

does

the

sightseeing

inquire

N-grams

in	where	does	the	sightseeing	inquire	?
			the

Output 2

Tourist

information

where?

N-grams

Tourist	information	in	where?
	information

Output 3

Where

does

the

sightseeing

ask

inquire

placed

in?

N-grams

Where	does	the	sightseeing	ask	to	inquire	to	be	placed	in?
Where		the

Output 4

Where

does

the

sightseeing

inquire

occupies?

N-grams

Where	does	the	sightseeing	inquire	occupies?
Where		the

Sentence 66) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.375/0/0/0)

Source

��

�T��

�y��

�C

Ref 0

Please

reserve

non-smoking

seat.

Ref 1

Please

book

non-smoking

seat.

Ref 2

I'd

book

non-smoking

seat,

please.

Ref 3

I'd

non-smoking

seat,

please.

Ref 4

Reserve

non-smoking

seat,

please.

Ref 5

Please

make

reservation

for

non-smoking

seat.

Output 0

Please

give

no-smoking

seats.

N-grams

Please	give	me	a	no-smoking	seats.
Please			a

Output 1

please

give

seat

N-grams

please

give

seat

Output 2

Please

give

no-smoking

seats.

N-grams

Please	give	me	a	no-smoking	seats.
Please			a

Output 3

Please

forbid

smoke

seat

for

me.

N-grams

Please	forbid	smoke	seat	for	me.
Please				for

Output 4

Please

give

ban

smoking

the

seat.

N-grams

Please	give	me	to	ban	smoking	the	seat.
Please			to				seat.

Sentence 67) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.3333/0/0)

Source

�Z��

��

�F

�C

Ref 0

The

toilet

seems

blocked.

Ref 1

The

toilet

seems

clogged.

Ref 2

The

toilet

appears

clogged

up.

Ref 3

The

toilet

seems

stopped

up.

Ref 4

The

toilet

seems

clogged

up.

Ref 5

The

toilet

appears

blocked.

Output 0

The

toilet

blocked

up.

N-grams

The	toilet	blocked	up.
The	toilet		up.
The toilet

Output 1

the

toilet

N-grams

the	toilet	up	.
	toilet

Output 2

Plugging

the

toilet.

N-grams

Plugging

the

toilet.

Output 3

The

toilet

blocked

up.

N-grams

The	toilet	blocked	up.
The	toilet		up.
The toilet

Output 4

The

restroom

stopped

up.

N-grams

The	restroom	stopped	up.
The		stopped	up.
		stopped up.

Sentence 68) BLEU: 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0/0/0/0)

Source

�q��

�F��

�F

�C

��

�@�U

��

�H

Ref 0

regret

inform

you

that

there

was

mistake

order.
Will

possible

change

order

this

stage?

Ref 1

regret

tell

you

that

there

was

error

order.
Would

possible

change

order

this

stage?

Ref 2

I'm

sorry

have

tell

you

that

there

was

error

order.
Can

change

order

this

stage?

Ref 3

sorry

but

there

was

problem

with

order.
Is

possible

change

order

this

point?

Ref 4

I'm

sorry,

but

there

was

mistake

order.
Is

possible

change

order

this

point?

Ref 5

regret

inform

you

that

there

was

mistake

order.
Is

still

possible

change

order

this

stage?

Output 0

Set

the

wrong

things.

And

can

correct

it?

N-grams

Set

the

wrong

things.

And

can

correct

it?

Output 1

the

wrong

can

thing

change

N-grams

the	wrong	can	thing	change	?
				change

Output 2

Set

the

wrong

things.

And

can

correct

it?

N-grams

Set

the

wrong

things.

And

can

correct

it?

Output 3

Order

wrong

thing.

Can

change

while?

N-grams

Order	wrong	thing.	Can	change	a	while?
				change	a

Output 4

Subscribed

the

wrong

thing.

Can

change?

N-grams

Subscribed

the

wrong

thing.

Can

change?

Sentence 69) BLEU: 0 (0.4/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0/0/0/0) ; 0 (0.125/0/0/0)

Source

��

�ݬ�

��

�C

Ref 0

Please

bring

menu.

Ref 1

Bring

menu,

please.

Ref 2

Can

have

menu,

please?

Ref 3

Can

please

see

menu.

Ref 4

I'd

menu,

please.

Ref 5

Would

you

bring

menu,

please?

Output 0

look

the

menu.

N-grams

I	look	at	the	menu.
I				menu.

Output 1

look

the

N-grams

look	at	the	menu	me	.
				me

Output 2

look

the

menu.

N-grams

I	look	at	the	menu.
I				menu.

Output 3

See

for

me.

N-grams

See

for

me.

Output 4

Has

look

the

me.

N-grams

Has	a	look	at	the	menu	to	me.
	a

Sentence 70) BLEU: 0 (0.4/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0/0/0/0)

Source

�S��

�s��

�C

Ref 0

have

coins.

Ref 1

have

coins.

Ref 2

I've

got

loose

change.

Ref 3

haven't

got

any

coins.

Ref 4

don't

have

any

coins.

Ref 5

have

loose

change.

Output 0

There

small

change.

N-grams

There	is	no	small	change.
		no		change.

Output 1

change

N-grams

change

Output 2

Did

not

change.

N-grams

Did	not	change.
		change.

Output 3

There

small

change.

N-grams

There	is	no	small	change.
		no		change.

Output 4

Without

the

pocket

money.

N-grams

Without

the

pocket

money.

Sentence 71) BLEU: 0 (0.3636/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.3636/0/0/0) ; 0 (0.5556/0.25/0.1429/0) ; 0 (0.1818/0/0/0)

Source

�藍�_

�o��

�M

��

�Q

�n

��

�@��

�C

Ref 0

I'm

sorry

but

this

not

what

have

mind.

Ref 1

Excuse

me,

but

this

not

what

have

mind.

Ref 2

regret

that

this

not

what

was

thinking

of.

Ref 3

I'm

sorry

but

this

isn't

what

want.

Ref 4

I'm

sorry

but

this

isn't

what

had

mind.

Ref 5

I'm

sorry

but

this

not

quite

what

had

mind.

Output 0

beg

your

pardon

and

want

this

not

the

same.

N-grams

I	beg	your	pardon	and	I	want	this	not	the	same.
I					I		this	not

Output 1

and

want

this

not

N-grams

i	and	want	this	not	is	.
			this	not	is

Output 2

beg

your

pardon

and

want

this

not

the

same.

N-grams

I	beg	your	pardon	and	I	want	this	not	the	same.
I					I		this	not

Output 3

Letting

this

down

different

from

what

want.

N-grams

Letting	this	down	is	different	from	what	I	want.
	this		is			what	I	want.
						what I
						what I want.
							I want.

Output 4

unfair

this

and

wants

not

dissimilar.

N-grams

Is	unfair	to	this	and	me	wants	not	to	be	dissimilar.
			this				not

Sentence 72) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0)

Source

�A

��

�b

��

�F

�C

Ref 0

This

bill

wrong.

Ref 1

There

mistake

this

bill.

Ref 2

This

bill

not

correct.

Ref 3

This

bill

not

right.

Ref 4

There

error

this

bill.

Ref 5

This

bill

wrong.

Output 0

You

miscalculated

the

account.

N-grams

You

miscalculated

the

account.

Output 1

account

wrong

you

the

N-grams

account

wrong

you

the

Output 2

Your

account

balance

wrong.

N-grams

Your	account	balance	wrong.
			wrong.

Output 3

You

calculated

the

debt

wrong.

N-grams

You	calculated	the	debt	wrong.
				wrong.

Output 4

You

miscalculated

the

account.

N-grams

You

miscalculated

the

account.

Sentence 73) BLEU: 0 (0.375/0.2857/0.1667/0) ; 0 (0.3333/0/0/0) ; 0 (0.375/0.2857/0.1667/0) ; 0 (0.2222/0/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�M

��

�@�_

��

�i

��

�H

Ref 0

Would

you

picture

with

me?

Ref 1

Would

you

the

photograph

with

me?

Ref 2

Would

you

mind

have

our

picture

taken

together?

Ref 3

Would

you

pose

for

picture

with

me?

Ref 4

Would

you

have

your

picture

taken

with

me?

Ref 5

Would

you

mind

being

picture

with

me?

Output 0

And

can

take

picture

with

it?

N-grams

And	I	can	take	a	picture	with	it?
				a	picture	with
				a picture
				a picture with
					picture with

Output 1

can

with

together

N-grams

can	a	with	me	together	?
	a	with

Output 2

And

can

take

picture

with

it?

N-grams

And	I	can	take	a	picture	with	it?
				a	picture	with
				a picture
				a picture with
					picture with

Output 3

Can

with

together

shine

piece

mutually?

N-grams

Can	with	me	together	shine	on	a	piece	mutually?
	with					a

Output 4

Can

photograph

together

with

me?

N-grams

Can	photograph	together	with	me?
	photograph		with	me?
			with me?

Sentence 74) BLEU: 0 (0.3/0.2222/0.125/0) ; 0 (0/0/0/0) ; 0 (0.3/0.2222/0.125/0) ; 0 (0.2/0/0/0) ; 0 (0.375/0.2857/0.1667/0)

Source

��

�H�Υd

�C

��

�B�q�d

�i�H

��

�H

Ref 0

Credit

card.
Do

you

take

American

Express?

Ref 1

Credit

card.
Do

you

American

Express?

Ref 2

Credit

card.
Can

pay

American

Express?

Ref 3

Credit

card.
Is

American

Express

okay?

Ref 4

Credit

card.
Do

you

take

American

Express?

Ref 5

Credit

card.
Can

pay

with

American

Express?

Output 0

credit

card.

American

Express

cards

can

used

it?

N-grams

By	credit	card.	American	Express	cards	can	be	used	it?
		card.	American	Express
		card. American
		card. American Express
			American Express

Output 1

credit

card

american

express

can

used

use

card

N-grams

credit

card

american

express

can

used

use

card

Output 2

credit

card.

American

Express

cards

can

used

it?

N-grams

By	credit	card.	American	Express	cards	can	be	used	it?
		card.	American	Express
		card. American
		card. American Express
			American Express

Output 3

Use

credit

card.

Can

the

American

luck

card

used?

N-grams

Use	credit	card.	Can	the	American	luck	card	be	used?
		card.			American

Output 4

With

credit

card.

American

Express

card

may

use?

N-grams

With	credit	card.	American	Express	card	may	use?
		card.	American	Express
		card. American
		card. American Express
			American Express

Sentence 75) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.3333/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0)

Source

@�@

�h��

��

�H

Ref 0

How

much

all

together?

Ref 1

How

much

the

total?

Ref 2

What

the

total

cost?

Ref 3

What's

the

total?

Ref 4

How

much

does

cost

all

together?

Ref 5

How

much

does

that

come

all

together?

Output 0

How

much

it?

N-grams

How	much	is	it?
How	much	is
How much
How much is
	much is

Output 1

how

much

N-grams

how	much	?
	much

Output 2

How

much

it?

N-grams

How	much	is	it?
How	much	is
How much
How much is
	much is

Output 3

Totally

how

much

N-grams

Totally	how	much	?
		much

Output 4

Altogether

how

much

money?

N-grams

Altogether	how	much	money?
		much

Sentence 76) BLEU: 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0/0/0/0)

Source

�A

��

�@

�M

��

�H

Ref 0

Would

you

second

helping?

Ref 1

Would

you

seconds?

Ref 2

Would

you

have

some

more?

Ref 3

you

want

another

helping?

Ref 4

you

want

seconds?

Ref 5

Would

you

second

serving?

Output 0

How

come

back

cup?

N-grams

How	to	come	back	a	cup?
	to			a

Output 1

how

cup

again

N-grams

how	to	cup	again	?
	to

Output 2

How

come

back

cup?

N-grams

How	to	come	back	a	cup?
	to			a

Output 3

How

about

coming

cupping

again?

N-grams

How	about	coming	to	1	cupping	again?
			to

Output 4

Comes

cup

what

kind

again?

N-grams

Comes

cup

what

kind

again?

Sentence 77) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�Q

�R

�C

Ref 0

feel

vomiting.

Ref 1

feel

throwing

up.

Ref 2

feel

vomiting.

Ref 3

feel

vomiting.

Ref 4

feel

vomiting.

Ref 5

feel

vomiting.

Output 0

Want

vomit.

N-grams

Want

vomit.

Output 1

N-grams

Output 2

Sick.

N-grams

Sick.

Output 3

Want

vomit.

N-grams

Want

vomit.

Output 4

Wants

spit.

N-grams

Wants

spit.

Sentence 78) BLEU: 0.3549 (0.6667/0.5/0.2857/0.1667) ; 0 (0.75/0.2857/0.1667/0) ; 0.3549 (0.6667/0.5/0.2857/0.1667) ; 0.2597 (0.5455/0.3/0.2222/0.125) ; 0 (0.4615/0.08333/0/0)

Source

�z

��

�i�D

��

�X��

��B

��

�H

Ref 0

Can

you

tell

where

the

taxi

stand

is?

Ref 1

Could

you

tell

where

the

taxi

stand

is?

Ref 2

Can

you

guide

the

taxi

park?

Ref 3

Could

you

tell

where

can

get

taxi?

Ref 4

Could

you

tell

where

the

taxi

stand

located?

Ref 5

Can

you

tell

where

the

taxi

stand

located?

Output 0

Can

you

tell

the

taxi

fare

department

it?

N-grams

Can	you	tell	me	the	taxi	fare	department	it?
Can	you	tell	me	the	taxi
Can you		tell me		the taxi
Can you tell
Can you tell me
	you tell
	you tell me

Output 1

can

you

tell

the

car

N-grams

can	you	tell	me	the	car	to	?
can	you	tell	me	the		to
	you tell
	you tell me
		tell me

Output 2

Can

you

tell

the

taxi

fare

Department

it?

N-grams

Can	you	tell	me	the	taxi	fare	Department	it?
Can	you	tell	me	the	taxi
Can you		tell me		the taxi
Can you tell
Can you tell me
	you tell
	you tell me

Output 3

Can

you

tell

the

for-rent

car

car?

N-grams

Can	you	tell	me	the	for-rent	car	to	go	by	car?
Can	you	tell	me	the			to
Can you		tell me
Can you tell
Can you tell me
	you tell
	you tell me

Output 4

You

can

tell

the

rental

car

ride

carriage

place?

N-grams

You

can

tell

the

rental

car

ride

carriage

place?

can

tell

the

tell me

Sentence 79) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.6667/0.5/0/0)

Source

�d�S

��

�b

��

�H

Ref 0

May

speak

Mr.

Carter?

Ref 1

Could

speak

Mr.

Carter?

Ref 2

Can

talk

Mr.

Carter?

Ref 3

Can

speak

with

Mr.

Carter?

Ref 4

Might

speak

Mr.

Carter?

Ref 5

Mr.

Carter

available,

please?

Output 0

Mr.

Carter

it?

N-grams

Mr.	Carter	in	it?
Mr.	Carter
Mr. Carter

Output 1

mr.

carter

N-grams

mr.

carter

Output 2

Mr.

Carter

it?

N-grams

Mr.	Carter	in	it?
Mr.	Carter
Mr. Carter

Output 3

Mr.

Carter

at?

N-grams

Mr.	Carter	at?
Mr.	Carter
Mr. Carter

Output 4

Mr.

Carter

in?

N-grams

Mr.	Carter	in?
Mr.	Carter
Mr. Carter

Sentence 80) BLEU: 0 (0.1429/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.1429/0/0/0)

Source

�o��

�ȹC

��

�h

��

�a��

�H

Ref 0

What

can

see

this

tour?

Ref 1

What

can

see

during

this

tour?

Ref 2

What

there

see

this

excursion?

Ref 3

What

there

see

this

tour?

Ref 4

What

can

seen

this

tour?

Ref 5

What

will

see

this

tour?

Output 0

Which

places

does

this

traveling

to?

N-grams

Which	places	does	this	traveling	go	to?
			this

Output 1

places

which

this

N-grams

places	go	which	this	?
			this

Output 2

The

tourist

places

are

what

go?

N-grams

The

tourist

places

are

what

go?

Output 3

Which

places

this

tours

all

go?

N-grams

Which	places	do	this	tours	all	go?
			this

Output 4

Which

places

does

this

traveling

to?

N-grams

Which	places	does	this	traveling	go	to?
			this

Sentence 81) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�A

��

�@�I

��

�H

Ref 0

Can't

you

make

earlier?

Ref 1

Couldn't

you

make

earlier?

Ref 2

Can't

you

make

earlier?

Ref 3

Could

you

make

earlier?

Ref 4

Could

you

make

any

earlier?

Ref 5

Can't

you

make

any

earlier?

Output 0

Again

earlier

all

right?

N-grams

Again

earlier

all

right?

Output 1

earlier

again

N-grams

earlier

again

Output 2

LITTLE

earlier

OK?

N-grams

LITTLE

earlier

OK?

Output 3

Again

earlier

all

right?

N-grams

Again

earlier

all

right?

Output 4

Again

early

spot?

N-grams

Again

early

spot?

Sentence 82) BLEU: 0 (0.3333/0.2/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0/0/0/0)

Source

��

�A

��

�@

��

�C

Ref 0

May

have

another

bowl

cereal?

Ref 1

Could

have

another

bowl

cereal?

Ref 2

Can

have

another

helping

cereal?

Ref 3

Can

have

one

bowl

cereal?

Ref 4

Might

have

another

bowl

cereal?

Ref 5

May

have

another

bowl

cereal?

Output 0

Please

give

one

oatmeal.

N-grams

Please	give	me	one	more	oatmeal.
			one	more
			one more

Output 1

please

give

N-grams

please

give

Output 2

Please

give

cereal.

N-grams

Please

give

cereal.

Output 3

Please

give

one

oatmeal.

N-grams

Please	give	me	one	more	oatmeal.
			one	more
			one more

Output 4

Please

again

give

rolled

cat.

N-grams

Please

again

give

rolled

cat.

Sentence 83) BLEU: 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�H

Ref 0

How

far

it?

Ref 1

How

far

from

here?

Ref 2

How

distant

it?

Ref 3

How

far

away

it?

Ref 4

How

far

away

from

here?

Ref 5

How

far

it?

Output 0

Far?

N-grams

Far?

Output 1

far

N-grams

far	?
far

Output 2

Far?

N-grams

Far?

Output 3

Far?

N-grams

Far?

Output 4

Far?

N-grams

Far?

Sentence 84) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0/0/0)

Source

�u

�n�Y

��

�C

Ref 0

enjoyed

the

dinner,

thank

you.

Ref 1

Thank

you.
We

enjoyed

the

dinner.

Ref 2

Thanks,

really

enjoyed

the

dinner.

Ref 3

really

liked

the

dinner,

thanks.

Ref 4

enjoyed

the

dinner,

thanks.

Ref 5

Thanks

very

much.
We

enjoyed

the

dinner.

Output 0

Really

good

thank

you.

N-grams

Really	good	thank	you.
		thank	you.
		thank you.

Output 1

really

delicious

thanks

N-grams

really	delicious	thanks	.
really

Output 2

Really

good

thank

you.

N-grams

Really	good	thank	you.
		thank	you.
		thank you.

Output 3

True

delicious

thanks.

N-grams

True	delicious	thanks.
		thanks.

Output 4

Thanks

really

delicious.

N-grams

Thanks	really	delicious.
Thanks	really

Sentence 85) BLEU: 0 (1/0.6667/0.5/0) ; 0 (0.5/0/0/0) ; 0 (1/0.6667/0.5/0) ; 0 (0.8/0.25/0/0) ; 0 (0.4/0/0/0)

Source

�z

��

�n

�@��

��

�H

Ref 0

Would

you

coffee?

Ref 1

Would

you

some

coffee?

Ref 2

you

want

coffee?

Ref 3

you

want

some

coffee?

Ref 4

you

want

any

coffee?

Ref 5

Some

coffee?

Output 0

Would

you

coffee?

N-grams

Would	you	like	coffee?
Would	you	like	coffee?
Would you
Would you like
	you like

Output 1

you

coffee

want

N-grams

you	coffee	want	?
you		want

Output 2

Would

you

coffee?

N-grams

Would	you	like	coffee?
Would	you	like	coffee?
Would you
Would you like
	you like

Output 3

you

still

want

coffee?

N-grams

Do	you	still	want	coffee?
Do	you		want	coffee?
Do you

Output 4

You

also

want

the

coffee?

N-grams

You	also	want	the	coffee?
		want		coffee?

Sentence 86) BLEU: 0 (0.8333/0.6/0.25/0) ; 0 (0.1667/0/0/0) ; 0 (0.8333/0.6/0.25/0) ; 0 (0.4/0.25/0/0) ; 0 (0.2/0/0/0)

Source

��

�`��]

�pô

�C

Ref 0

Please

call

the

Consulate

General.

Ref 1

Call

the

Consulate

General,

please.

Ref 2

Please

phone

the

Consulate

General.

Ref 3

Please

contact

the

Consulate

General.

Ref 4

Phone

the

Consulate

General,

please.

Ref 5

Please

put

call

the

Consulate

General.

Output 0

Please

contact

with

the

Consulate

General.

N-grams

Please	contact	with	the	Consulate	General.
Please	contact		the	Consulate	General.
Please contact			the Consulate
			the Consulate General.
				Consulate General.

Output 1

please

contact

with

consulate

general

N-grams

please	contact	with	consulate	general	.
	contact

Output 2

Please

contact

with

the

Consulate

General.

N-grams

Please	contact	with	the	Consulate	General.
Please	contact		the	Consulate	General.
Please contact			the Consulate
			the Consulate General.
				Consulate General.

Output 3

Please

contact

with

general

consulate.

N-grams

Please	contact	with	general	consulate.
Please	contact
Please contact

Output 4

Please

with

general

consulate

relation.

N-grams

Please	with	general	consulate	relation.
Please

Sentence 87) BLEU: 1 (1/1/1/1) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 0 (0/0/0/0)

Source

��

�b

��

�H

Ref 0

Where's

the

dining

room?

Ref 1

Where

the

dining

room?

Ref 2

Where

the

dining

hall?

Ref 3

Where's

the

dining

hall?

Ref 4

Where

can

find

the

dining

room?

Ref 5

Where

the

dining

room

located?

Output 0

Where

the

dining

room?

N-grams

Where	is	the	dining	room?
Where	is	the	dining	room?
Where is		the dining
Where is the			dining room?
Where is the dining
	is the
	is the dining
	is the dining room?
		the dining room?

Output 1

where

N-grams

where

Output 2

Canteen

where?

N-grams

Canteen

where?

Output 3

Where

the

dining

room

N-grams

Where	is	the	dining	room	?
Where	is	the	dining	room
Where is		the dining
Where is the			dining room
Where is the dining
	is the
	is the dining
	is the dining room
		the dining room

Output 4

Cafeteria

where?

N-grams

Cafeteria

where?

Sentence 88) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�i�H

�ЫK

�C

Ref 0

ahead

and

take

it.

Ref 1

Take

it.

Ref 2

and

have

it.

Ref 3

and

take

it.

Ref 4

Just

take

it.

Ref 5

ahead,

take

it,

please

Output 0

Can

ahead.

N-grams

Can

ahead.

Output 1

can

you

N-grams

can

you

Output 2

Can

ahead.

N-grams

Can

ahead.

Output 3

Can

you

like.

N-grams

Can

you

like.

Output 4

May

you

please.

N-grams

May

you

please.

Sentence 89) BLEU: 0.4111 (0.75/0.5714/0.3333/0.2) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.4167/0.09091/0/0) ; 0 (0.4545/0.2/0/0)

Source

��

�b

��

��M

��

�C

Ref 0

I'm

looking

for

brown

suit.

Ref 1

searching

for

brown

suit.

Ref 2

would

brown

outfit.

Ref 3

trying

find

brown

suit.

Ref 4

I'm

trying

find

brown

suit.

Ref 5

I'm

looking

for

suit,

brown.

Output 0

looking

for

brown

suit

sets.

N-grams

I	am	looking	for	a	brown	suit	sets.
I	am	looking	for	a	brown
I am		looking for		a brown
		looking for a
		looking for a brown
			for a
			for a brown

Output 1

looking

for

brown

dark

N-grams

i	am	looking	for	a	brown	dark	.
	am	looking	for	a	brown
		looking for		a brown
		looking for a
		looking for a brown
			for a
			for a brown

Output 2

looking

for

brown

suit

sets.

N-grams

I	am	looking	for	a	brown	suit	sets.
I	am	looking	for	a	brown
I am		looking for		a brown
		looking for a
		looking for a brown
			for a
			for a brown

Output 3

finding

dark

brown

ground

become

set

western

dress.

N-grams

I	am	finding	dark	brown	ground	to	become	a	set	western	dress.
I	am			brown		to		a
I am

Output 4

looking

for

the

dark

brown

the

complete

western-style

clothing.

N-grams

I	am	looking	for	the	dark	brown	the	complete	western-style	clothing.
I	am	looking	for			brown
I am		looking for

Sentence 90) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.2/0/0)

Source

�ж�

��

�O

��

�G

�C

Ref 0

The

lights

room

aren't

working.

Ref 1

The

lights

room

are

broken.

Ref 2

The

lighting

room

not

working.

Ref 3

The

lights

room

won't

come

on.

Ref 4

The

lights

room

don't

work.

Ref 5

The

lights

room

are

not

working.

Output 0

The

light

room

isn't

bright.

N-grams

The	light	of	room	isn't	bright.
The			room

Output 1

room

light

not

the

bright

N-grams

room	light	not	the	bright	.
room		not

Output 2

Room

light

does

not

shine.

N-grams

Room	light	does	not	shine.
			not

Output 3

The

light

room

isn't

bright.

N-grams

The	light	of	room	isn't	bright.
The			room

Output 4

The

room

lamp

not

bright.

N-grams

The	room	lamp	is	not	bright.
The	room		is	not
			is not

Sentence 91) BLEU: 0 (0.5/0.2222/0/0) ; 0 (0.5556/0.25/0/0) ; 0.3247 (0.7/0.4444/0.25/0.1429) ; 0 (0.7143/0.1667/0/0) ; 0 (0.6/0.2222/0/0)

Source

�q

�o��

��

��߳ժ��]

��

�h

��

�H

Ref 0

Can

walk

the

City

Museum

from

here?

Ref 1

Could

walk

the

City

Museum

from

here?

Ref 2

Can

the

City

Museum

from

here

foot?

Ref 3

possible

walk

the

City

Museum

from

here?

Ref 4

the

City

Museum

within

walking

distance

from

here?

Ref 5

Can

get

the

City

Museum

foot

from

here?

Output 0

From

here

the

city

museum

can

walk

it?

N-grams

From	here	to	the	city	museum	can	walk	to	it?
	here	to	the				walk	to
		to the					walk to

Output 1

from

here

the

museum

can

walk

municipal

N-grams

from	here	to	the	museum	can	walk	municipal	?
from	here	to	the			walk
from here		to the

Output 2

From

here

the

City

Museum

can

walk

it?

N-grams

From	here	to	the	City	Museum	can	walk	to	it?
	here	to	the	City	Museum		walk	to
		to the		City Museum			walk to
		to the City
		to the City Museum
			the City
			the City Museum

Output 3

Can

walk

from

here

municipal

museum?

N-grams

Can	walk	from	here	to	municipal	museum?
Can	walk	from	here	to
		from here

Output 4

Can

walk

from

here

the

municipal

museum

going?

N-grams

Can	walk	from	here	to	the	municipal	museum	is	going?
Can	walk	from	here	to	the
		from here		to the

Sentence 92) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�u�n

��

�@�U

�N

��

�F

�C

Ref 0

Just

packing.

Ref 1

Just

packing.

Ref 2

Just

doing

bags.

Ref 3

Just

packing.

Ref 4

Merely

packing.

Ref 5

Just

packing

bags.

Output 0

long

the

premium

you

will

do.

N-grams

long

the

premium

you

will

do.

Output 1

long

N-grams

long

Output 2

long

the

premium

you

will

do.

N-grams

long

the

premium

you

will

do.

Output 3

long

repaired

while

go.

N-grams

long

repaired

while

go.

Output 4

long

made

good.

N-grams

long

made

good.

Sentence 93) BLEU: 0 (0.3636/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.5556/0.125/0/0) ; 0 (0.3333/0/0/0)

Source

@�I

�T�Q��

�_��

�X�I

��F

ù��

�H

Ref 0

When

does

the

one

thirty

flight

arrive

Rome?

Ref 1

When

does

the

one

thirty

flight

arrive

Rome?

Ref 2

what

time

does

the

one

thirty

flight

get

Rome?

Ref 3

What

time

does

the

one

thirty

flight

get

Rome?

Ref 4

What

time

does

the

one

thirty

flight

arrive

Rome?

Ref 5

When

does

the

one

thirty

flight

arrive

Rome?

Output 0

How

many

spots:

does

take

off

arrive

Rome?

N-grams

How	many	spots:	30	does	take	off	to	arrive	at	Rome?
				does			to	arrive		Rome?

Output 1

arrive

rome

take

off

N-grams

1	:	30	arrive	rome	take	off	at	to	?
			arrive					to

Output 2

1:30

Arrive

Rome

few

take-off?

N-grams

1:30	Arrive	in	Rome	a	few	take-off?
		in

Output 3

Take

off

1:30

what

time

arrive

Rome?

N-grams

Take	off	at	1:30	what	time	to	arrive	Rome?
				what	time	to	arrive	Rome?
				what time

Output 4

How

many

spots

does

take

off

arrive

Rome?

N-grams

How	many	spots	:	30	does	take	off	to	arrive	at	Rome?
					does			to	arrive		Rome?

Sentence 94) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.5/0/0/0)

Source

��

�Q

�n

�Q��

�C

Ref 0

need

guide.

Ref 1

require

guide.

Ref 2

require

escort.

Ref 3

need

guide.

Ref 4

need

guide.

Ref 5

need

tour

guide.

Output 0

want

guide.

N-grams

I	want	a	guide.
I		a	guide.
		a guide.

Output 1

the

want

guide

N-grams

the

want

guide

Output 2

I'd

the

wizard.

N-grams

I'd

the

wizard.

Output 3

want

guide.

N-grams

I	want	a	guide.
I		a	guide.
		a guide.

Output 4

want

the

guide.

N-grams

I	want	the	guide.
I			guide.

Sentence 95) BLEU: 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0)

Source

��

�Y

��

�w

�F

�C

��

�O

�Ʀr

�C

Ref 0

Oh,

feel

dizzy.
The

numbers

are

spinning.

Ref 1

Oh,

feeling

dizzy.
The

numbers

are

spinning.

Ref 2

Oh,

feel

light-headed.
The

numbers

are

whirling.

Ref 3

Oh,

I'm

really

dizzy.
The

numbers

are

spinning.

Ref 4

Oh,

I'm

feeling

light-headed.
The

numbers

are

spinning.

Ref 5

Oh,

I'm

feeling

dizzy.
The

numbers

seem

spinning.

Output 0

Ah,

first

have

fainted.

All

figures.

N-grams

Ah,	I	first	have	fainted.	All	figures.
	I

Output 1

fainted

all

the

N-grams

fainted

all

the

Output 2

Ah,

first

have

fainted.

All

figures.

N-grams

Ah,	I	first	have	fainted.	All	figures.
	I

Output 3

the

heads

are

all

dizzy.

Whole

numeral.

N-grams

I	the	heads	are	all	dizzy.	Whole	is	numeral.
I			are		dizzy.

Output 4

fainted.

the

digit.

N-grams

fainted.

the

digit.

Sentence 96) BLEU: 0 (0.4286/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6667/0.4/0.25/0)

Source

�p�G

�i�H

��

�U

�@

��

��D

�a

�C

Ref 0

it's

okay

with

you,

let's

move

the

topic.

Ref 1

Let's

move

the

topic,

it's

okay

with

you.

Ref 2

alright

with

you,

I'd

carry

the

item.

Ref 3

it's

all

right

with

you,

let's

the

topic.

Ref 4

it's

not

problem

for

you,

let's

move

the

subject.

Ref 5

it's

okay

with

you,

I'd

prefer

for

move

the

topic.

Output 0

you

can

talk

about

subject.

N-grams

If	you	can	talk	about	a	subject.
If					a	subject.

Output 1

can

talk

topic

N-grams

if	can	talk	next	topic	.
if			next

Output 2

you

can

talk

about

subject.

N-grams

If	you	can	talk	about	a	subject.
If					a	subject.

Output 3

can

talk

topic.

N-grams

If	can	talk	next	topic.
If			next	topic.
			next topic.

Output 4

may

discuss

the

topic.

N-grams

If	may	discuss	the	next	topic.
If			the	next	topic.
			the next
			the next topic.
				next topic.

Sentence 97) BLEU: 0 (0.4286/0/0/0) ; 0 (0.1667/0/0/0) ; 0.3457 (0.5/0.4286/0.3333/0.2) ; 0 (0.2/0/0/0) ; 0 (0.4286/0/0/0)

Source

��

�Q

��

�ⴣ

��

�H�s

�_��

�C

Ref 0

I'd

leave

luggage.

Ref 1

would

prefer

leave

bags.

Ref 2

would

leave

bags.

Ref 3

would

leave

luggage.

Ref 4

I'd

leave

luggage.

Ref 5

I'd

leave

luggage.

Output 0

want

check

the

hand

luggage.

N-grams

I	want	to	check	the	hand	luggage.
I		to				luggage.

Output 1

hand

luggage

the

N-grams

i	to	hand	luggage	the	.
	to

Output 2

would

hand

luggage

storage

together.

N-grams

I	would	like	to	hand	luggage	storage	together.
I	would	like	to
I would		like to
I would like
I would like to
	would like
	would like to

Output 3

think

that

the

handle

knob

lifts

baggage

deposit.

N-grams

I	think	that	the	handle	knob	lifts	baggage	to	deposit.
I								to

Output 4

want

check

the

hand

luggage.

N-grams

I	want	to	check	the	hand	luggage.
I		to				luggage.

Sentence 98) BLEU: 0 (0.25/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.25/0/0/0)

Source

�o��

�y��

��

�H

Ref 0

this

seat

taken?

Ref 1

this

seat

occupied?

Ref 2

this

place

taken?

Ref 3

anyone

sitting

here?

Ref 4

this

seat

taken

already?

Ref 5

this

seat

already

taken?

Output 0

This

seat

empty

it?

N-grams

This	seat	empty	it?
	seat

Output 1

this

seat

empty

N-grams

this	seat	empty	?
this	seat
this seat

Output 2

This

seat

empty

it?

N-grams

This	seat	empty	it?
	seat

Output 3

Does

this

seat

get

empty?

N-grams

Does	this	seat	get	empty?
	this	seat
	this seat

Output 4

This

seat

emptying?

N-grams

This	seat	is	emptying?
	seat

Sentence 99) BLEU: 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0)

Source

�P��

��

�C

Ref 0

feel

hot.

Ref 1

feel

very

warm.

Ref 2

I'm

hot.

Ref 3

hot.

Ref 4

very

warm.

Ref 5

feeling

hot.

Output 0

Feel

hot.

N-grams

Feel	hot.
	hot.

Output 1

feel

hot

N-grams

feel	hot	.
feel

Output 2

Feel

hot.

N-grams

Feel	hot.
	hot.

Output 3

Feel

hot.

N-grams

Feel	hot.
	hot.

Output 4

Feels

the

heat.

N-grams

Feels

the

heat.

Sentence 100) BLEU: 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�Q

�n

��

�C

Ref 0

need

laxative.

Ref 1

require

laxative.

Ref 2

have

laxative.

Ref 3

I've

got

get

some

medication

for

constipation.

Ref 4

require

some

medication

for

constipation.

Ref 5

need

laxative.

Output 0

want

release

the

medicine.

N-grams

I	want	to	release	the	medicine.
I		to

Output 1

want

medicine

N-grams

i	want	to	medicine	.
		to

Output 2

want

vent

medicine.

N-grams

I	want	to	vent	medicine.
I		to

Output 3

want

leak

medicine.

N-grams

I	want	to	leak	a	medicine.
I		to		a

Output 4

want

release

the

medicine.

N-grams

I	want	to	release	the	medicine.
I		to

Sentence 101) BLEU: 1 (1/1/1/1) ; 0 (0.4/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.6/0.25/0/0)

Source

��

�O

�G

�~��

�ǥ�

�C

Ref 0

I'm

sophomore.

Ref 1

sophomore.

Ref 2

I'm

second

year

student.

Ref 3

second

year

college.

Ref 4

I'm

second

year.

Ref 5

I'm

sophomore.

Output 0

sophomore.

N-grams

I	am	a	sophomore.
I	am	a	sophomore.
I am		a sophomore.
I am a
I am a sophomore.
	am a
	am a sophomore.

Output 1

student

N-grams

i	am	a	student	.
	am	a
	am a

Output 2

sophomore.

N-grams

I	am	a	sophomore.
I	am	a	sophomore.
I am		a sophomore.
I am a
I am a sophomore.
	am a
	am a sophomore.

Output 3

grade

two

student.

N-grams

I	am	a	grade	two	student.
I	am	a			student.
I am
I am a
	am a

Output 4

the

second-grade

student.

N-grams

I	am	the	second-grade	student.
I	am			student.
I am

Sentence 102) BLEU: 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�H

Ref 0

How

was

your

meal?

Ref 1

How

was

your

meal?

Ref 2

what

was

your

meal

like?

Ref 3

Was

your

food

okay?

Ref 4

How

was

your

food?

Ref 5

How

was

your

meal?

Output 0

The

vegetable

what

kind

of?

N-grams

The	vegetable	is	what	kind	of?
			what

Output 1

how

N-grams

how

Output 2

How

dish?

N-grams

How	to	dish?
How

Output 3

How

vegetables?

N-grams

How	is	vegetables?
How

Output 4

The

vegetable

what

kind

of?

N-grams

The	vegetable	is	what	kind	of?
			what

Sentence 103) BLEU: 0 (1/1/0/0) ; 0 (0/0/0/0) ; 0 (1/1/0/0) ; 0 (1/1/0/0) ; 0 (0.3333/0/0/0)

Source

��

�P��

�C

Ref 0

Two

weeks.

Ref 1

Two

weeks.

Ref 2

A	fortnight.

Ref 3

Fourteen

days.

Ref 4

Two

weeks.

Ref 5

Two

weeks.

Output 0

Two

weeks.

N-grams

Two	weeks.
Two	weeks.
Two weeks.

Output 1

two

weeks

N-grams

two

weeks

Output 2

Two

weeks.

N-grams

Two	weeks.
Two	weeks.
Two weeks.

Output 3

Two

weeks.

N-grams

Two	weeks.
Two	weeks.
Two weeks.

Output 4

Two

star

times.

N-grams

Two	star	times.
Two

Sentence 104) BLEU: 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.3333/0/0/0)

Source

�O

�Ԣ�ϢܢѢ�

��

�H

Ref 0

France?

Ref 1

France?

Ref 2

France?

Ref 3

France?

Ref 4

France?

Ref 5

that

France?

Output 0

the

��

the

��?

N-grams

Is	the	��	of	the	��?
Is

Output 1

france

N-grams

france

Output 2

FRANCE

F-are

you?

N-grams

FRANCE

F-are

you?

Output 3

the

��

the

�Ԣ�ϢܢѢ�

N-grams

Is	the	��	of	the	�Ԣ�ϢܢѢ�	?
Is

Output 4

FRANCE

N-grams

Is	FRANCE	F?
Is

Sentence 105) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.1429/0/0/0)

Source

��

�ȱo

�@

��

�H

Ref 0

that

worth

visiting?

Ref 1

that

worth

visiting?

Ref 2

worth

going

see

that?

Ref 3

worth

seeing?

Ref 4

that

worth

seeing?

Ref 5

that

worth

visit?

Output 0

There

see

it?

N-grams

There	to	see	it?
	to	see
	to see

Output 1

there

worth

N-grams

there	worth	?
	worth

Output 2

There

see

it?

N-grams

There	to	see	it?
	to	see
	to see

Output 3

there

well

worth

seeing?

N-grams

Am	there	well	worth	seeing?
			worth	seeing?
			worth seeing?

Output 4

soon

there

worth

looking?

N-grams

As	soon	as	there	is	worth	looking?
					worth

Sentence 106) BLEU: 0 (0.4167/0.09091/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.4167/0.09091/0/0) ; 0 (0/0/0/0)

Source

��

�F

�R

��

��}

�@

��

�o

�O

�p��

�C

Ref 0

asked

for

and

bought

medium

size,

but

when

opened

it,

was

small.

Ref 1

requested

and

purchased

medium

size,

but

when

opened

it,

was

small.

Ref 2

requested

and

purchased

medium

size,

but

when

unpacked

it,

was

small.

Ref 3

requested

and

purchased

medium,

but

when

opened

it,

was

small.

Ref 4

asked

for

and

bought

medium,

but

when

opened

it,

was

small.

Ref 5

asked

for

and

bought

size

medium,

but

when

opened

it,

was

size

small.

Output 0

Say

that

buy

medium

open

see

but

small.

N-grams

Say	that	buy	medium	to	open	a	see	but	is	a	small.
			medium			a		but		a	small.
										a small.

Output 1

said

open

buy

trumpet

N-grams

said

open

buy

trumpet

Output 2

Said

its

open

buy

one

watch

trumpet.

N-grams

Said

its

open

buy

one

watch

trumpet.

Output 3

Say

that

buy

medium

open

see

but

small.

N-grams

Say	that	buy	medium	to	open	a	see	but	is	a	small.
			medium			a		but		a	small.
										a small.

Output 4

Said

soon

buys

the

medium-sized

open

looked

actually

the

trumpet.

N-grams

Said

soon

buys

the

medium-sized

open

looked

actually

the

trumpet.

Sentence 107) BLEU: 0.3656 (0.625/0.4286/0.3333/0.2) ; 0 (0.625/0.2857/0.1667/0) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0 (0.625/0.2857/0.1667/0) ; 0 (0.4444/0.125/0/0)

Source

��

��W

�~

�n

�C

Ref 0

morning,

the

day

after

tomorrow.

Ref 1

morning,

the

day

after

tomorrow.

Ref 2

morning,

not

tomorrow

but

the

day

after.

Ref 3

morning,

the

day

after

tomorrow.

Ref 4

morning

the

day

after

tomorrow.

Ref 5

the

morning

the

day

after

tomorrow.

Output 0

Good

morning

wash

the

day

after

tomorrow.

N-grams

Good	morning	to	wash	the	day	after	tomorrow.
	morning			the	day	after	tomorrow.
				the day		after tomorrow.
				the day after
				the day after tomorrow.
					day after
					day after tomorrow.

Output 1

morning

wash

the

day

after

tomorrow

will

N-grams

morning	wash	the	day	after	tomorrow	will	.
morning		the	day	after	tomorrow
		the day
		the day after
			day after

Output 2

Good

morning

wash

the

day

after

tomorrow.

N-grams

Good	morning	to	wash	the	day	after	tomorrow.
	morning			the	day	after	tomorrow.
				the day		after tomorrow.
				the day after
				the day after tomorrow.
					day after
					day after tomorrow.

Output 3

Will

wash

the

day

after

tomorrow

morning

like.

N-grams

Will	wash	the	day	after	tomorrow	morning	like.
		the	day	after	tomorrow	morning
		the day
		the day after
			day after

Output 4

The

day

after

tomorrow

will

wash

the

morning.

N-grams

The	day	after	tomorrow	will	wash	in	the	morning.
	day	after	tomorrow				the
	day after

Sentence 108) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�Q

�n

�n��

�C

Ref 0

I'd

some

building

blocks.

Ref 1

would

some

building

blocks.

Ref 2

want

some

building

bricks.

Ref 3

I'd

some

building

blocks.

Ref 4

I'd

some

building

blocks.

Ref 5

I'd

get

some

building

blocks.

Output 0

want

block.

N-grams

I	want	to	block.
I	want	to
I want

Output 1

want

block

N-grams

i	want	block	.
	want

Output 2

want

block.

N-grams

I	want	to	block.
I	want	to
I want

Output 3

want

wooden

blocks.

N-grams

I	want	wooden	blocks.
I	want		blocks.
I want

Output 4

want

the

building

block.

N-grams

I	want	the	building	block.
I	want		building
I want

Sentence 109) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.25/0/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.6/0/0/0)

Source

��

�O

��

�H

Ref 0

Where

the

nearest

station?

Ref 1

Where

the

closest

station?

Ref 2

Where's

the

nearest

station?

Ref 3

Where

the

nearest

station?

Ref 4

Where's

the

closest

station?

Ref 5

Where

the

nearest

station?

Output 0

Where

are

the

nearest

station?

N-grams

Where	are	the	nearest	station?
Where		the	nearest	station?
		the nearest
		the nearest station?
			nearest station?

Output 1

where

the

station

N-grams

where	the	station	?
	the

Output 2

Where

are

the

nearest

station?

N-grams

Where	are	the	nearest	station?
Where		the	nearest	station?
		the nearest
		the nearest station?
			nearest station?

Output 3

Where

the

recent

station

N-grams

Where	is	the	recent	station	?
Where	is	the
Where is
Where is the
	is the

Output 4

Where

was

the

recently

station?

N-grams

Where	was	the	recently	station?
Where		the		station?

Sentence 110) BLEU: 0 (1/1/0/0) ; 0 (0.2/0/0/0) ; 0 (1/1/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2/0/0/0)

Source

��W�n

�C

Ref 0

Good

morning.

Ref 1

Good

morning.

Ref 2

Good

morning.

Ref 3

Good

morning.

Ref 4

Good

morning.

Ref 5

Good

morning

you.

Output 0

Good

morning.

N-grams

Good	morning.
Good	morning.
Good morning.

Output 1

good

morning

the

N-grams

good	morning	in	the	.
	morning

Output 2

Good

morning.

N-grams

Good	morning.
Good	morning.
Good morning.

Output 3

Good

the

morning.

N-grams

Good	in	the	morning.
Good			morning.

Output 4

the

morning

good.

N-grams

In	the	morning	is	good.
		morning

Sentence 111) BLEU: 0 (0.6667/0.2727/0.1/0) ; 0 (0.4615/0.1667/0.09091/0) ; 0 (0.5833/0.2727/0.1/0) ; 0 (0.3333/0/0/0) ; 0 (0.5455/0.2/0.1111/0)

Source

��

�z

�i�D

��

�b

�o

�i

�a��

�W

��

��m

�H

Ref 0

Could

you

show

where

the

Tower

Building

the

map?

Ref 1

Can

you

point

out

where

the

Tower

Building

the

map?

Ref 2

Would

you

indicate

the

map

where

the

Tower

Building

for

please?

Ref 3

Could

you

point

out

where

the

Tower

Building

this

map?

Ref 4

Could

you

point

out

the

Tower

Building

the

map?

Ref 5

Could

you

point

out

where

the

Tower

Building

the

map?

Output 0

Would

you

please

tell

this

Tower

the

map

where?

N-grams

Would	you	please	tell	me	in	this	Tower	on	the	map	where?
Would	you			me		this	Tower	on	the	map
Would you								on the
								on the map
									the map

Output 1

you

please

tell

this

tower

the

map

which

position

N-grams

you

please

tell

this

tower

the

map

which

position

you

this

the

map

on the

on the map

the map

Output 2

Would

you

please

tell

this

tower

the

map

where?

N-grams

Would	you	please	tell	me	in	this	tower	on	the	map	where?
Would	you			me		this		on	the	map
Would you								on the
								on the map
									the map

Output 3

Please

tell

the

tower

building

this

map

which

position?

N-grams

Please	tell	me	the	tower	building	in	this	map	of	which	position?
		me	the				this	map

Output 4

Which

position

asks

you

tell

turret

this

map?

N-grams

Which	position	asks	you	to	tell	me	turret	on	this	map?
			you	to		me		on	this	map?
								on this
								on this map?
									this map?

Sentence 112) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�O

��

�H

Ref 0

Really?

Ref 1

Really?

Ref 2

Really?

Ref 3

that

so?

Ref 4

Truly?

Ref 5

Are

you

sure?

Output 0

not

it?

N-grams

Is	not	it?
Is

Output 1

N-grams

Output 2

not

it?

N-grams

Is	not	it?
Is

Output 3

BE?

N-grams

BE?

Output 4

Yes?

N-grams

Yes?

Sentence 113) BLEU: 0 (0.5/0.1111/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0.1111/0/0) ; 0 (0.4/0.1111/0/0)

Source

��

�q�v

�w�i��

�H

Ref 0

Where

can

find

the

movie

listings?

Ref 1

Where

can

find

the

listings

movies?

Ref 2

Where

are

the

film

listings?

Ref 3

Where

can

find

out

what

movies

are

playing?

Ref 4

Where

are

the

movie

listings?

Ref 5

Where

are

the

movies

listed?

Output 0

Where

there

the

form

the

movie

prior

announcement?

N-grams

Where	there	is	the	form	of	the	movie	prior	announcement?
Where			the		of	the movie
							movie

Output 1

where

has

movie

table

the

N-grams

where	has	movie	table	the	the	?
		movie		the

Output 2

Where

has

movie

trailers

Table?

N-grams

Where	has	movie	trailers	Table?
Where		movie

Output 3

Where

there

the

form

the

movie

prior

announcement?

N-grams

Where	there	is	the	form	of	the	movie	prior	announcement?
Where			the		of	the movie
							movie

Output 4

Where

has

the

movie

give

advance

notice

the

table?

N-grams

Where	has	the	movie	to	give	advance	notice	the	table?
Where		the	movie
		the movie

Sentence 114) BLEU: 0 (0.2857/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�Ҽ{

��

�A

�M

�z

�pô

�C

Ref 0

Let

get

back

you.

Ref 1

Let

get

back

you.

Ref 2

I'll

get

back

you.

Ref 3

I'll

get

touch

with

you

later.

Ref 4

Let

get

back

you.

Ref 5

I'll

have

get

back

you.

Output 0

After

consider

again

contact

with

you.

N-grams

After	I	consider	again	contact	with	you.
					with	you.

Output 1

considered

contact

you

again

with

N-grams

i	considered	contact	you	again	with	.
			you		with

Output 2

considered

and

then

contact

you.

N-grams

I	considered	and	then	contact	you.
					you.

Output 3

After

consider

again

contact

with

you.

N-grams

After	I	consider	again	contact	with	you.
					with	you.

Output 4

considered,

contacts

again

with

you.

N-grams

I	considered,	contacts	again	with	you.
				with	you.

Sentence 115) BLEU: 0.3682 (0.5882/0.4375/0.3333/0.2143) ; 0 (0.4/0.2143/0/0) ; 0 (0.6364/0.4/0.1111/0) ; 0.2082 (0.4286/0.25/0.1579/0.1111) ; 0.2622 (0.5294/0.3125/0.2/0.1429)

Source

��

�Q

�h

��
��

��

�]��

�βy��

�C

Ref 0

I'd

Yankee

Stadium

see

night

game

this

evening.

Ref 1

want

Yankee

Stadium

see

night

game

tonight.

Ref 2

want

Yankee

Stadium

watch

night

game

this

evening.

Ref 3

want

game

Yankee

Stadium

tonight.

Ref 4

would

Yankee

Stadium

this

evening

see

night

game.

Ref 5

I'd

Yankee

Stadium

this

evening

see

night

game.

Output 0

Tonight

want

the

Yankee

Stadium

watch

the

evening

performance

good

sports

match.

N-grams

Tonight

want

the

Yankee

Stadium

watch

the

evening

performance

good

sports

match.

want

Yankee

Stadium

watch

evening

I want

to go

Yankee Stadium

to watch

I want to

go to

Yankee Stadium to

I want to go

Yankee Stadium to watch

want to

Stadium to

want to go

Stadium to watch

want to go to

to go to

Output 1

tonight

want

watch

the

night

yankee

stadium

baseball

field

the

N-grams

tonight

want

watch

the

night

yankee

stadium

baseball

field

the

want

watch

night

want to

go to

to watch

Output 2

Tonight

want

watch

the

night

Yankee

Stadium

baseball

field.

N-grams

Tonight	I	want	to	watch	the	night	Yankee	Stadium	baseball	field.
	I	want	to	watch		night	Yankee	Stadium
	I want		to watch				Yankee Stadium
	I want to
		want to

Output 3

want

the

baseball

game

the

field

that

the

stadium

Yang

sees

night

tonight.

N-grams

want

the

baseball

game

the

field

that

the

stadium

Yang

sees

night

tonight.

want

game

night

tonight.

I want

to go

a night

I want to

go to

I want to go

want to

want to go

want to go to

to go to

Output 4

Tonight

want

the

Yankee

stadium

watch

the

evening

performance

good

sports

match.

N-grams

Tonight

want

the

Yankee

stadium

watch

the

evening

performance

good

sports

match.

want

Yankee

watch

evening

I want

to go

to watch

I want to

go to

I want to go

want to

want to go

want to go to

to go to

Sentence 116) BLEU: 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0)

Source

�ݭn

��

�H

Ref 0

have

pay

deposit?

Ref 1

have

leave

deposit?

Ref 2

Should

leave

deposit?

Ref 3

have

give

you

deposit?

Ref 4

deposit

required?

Ref 5

have

put

down

deposit?

Output 0

Needs

the

deposit?

N-grams

Needs	the	deposit?
		deposit?

Output 1

deposit

N-grams

deposit	?
deposit

Output 2

Required

deposit

it?

N-grams

Required	deposit	it?
	deposit

Output 3

Need

security

deposit?

N-grams

Need	security	deposit?
		deposit?

Output 4

Needs

the

deposit?

N-grams

Needs	the	deposit?
		deposit?

Sentence 117) BLEU: 0 (0.4167/0.2727/0.1/0) ; 0 (0.5333/0.2143/0.07692/0) ; 0 (0.4167/0.2727/0.1/0) ; 0 (0.5714/0.1538/0.08333/0) ; 0 (0.5625/0.1333/0/0)

Source

�u�n

�O

��

�n

��

�ɶq

��

�Y

�C

Ref 0

long

it's

good

for

body,

I'll

eat

anything.

Ref 1

I'll

eat

anything

long

good

for

body.

Ref 2

I'd

eat

anything,

just

long

beneficial

for

body.

Ref 3

long

it's

good

for

me,

I'll

eat

just

about

anything.

Ref 4

long

good

for

me,

I'll

eat

anything.

Ref 5

I'll

eat

anything,

just

long

it's

good

for

body.

Output 0

long

the

body

are

good,

try

eat

anything.

N-grams

As	long	as	the	body	are	good,	I	try	to	eat	anything.
As	long	as								eat	anything.
As long										eat anything.
As long as
	long as

Output 1

long

the

body

good

eat

anything

far

possible

N-grams

long

the

body

good

eat

anything

far

possible

long

good

eat

anything

as long

eat anything

as long as

long as

Output 2

long

the

body

are

good,

try

eat

anything.

N-grams

As	long	as	the	body	are	good,	I	try	to	eat	anything.
As	long	as								eat	anything.
As long										eat anything.
As long as
	long as

Output 3

long

body

good

far

possible

eat

everything.

N-grams

long

body

good

far

possible

eat

everything.

long

good

eat

As long

As long as

long as

Output 4

long

good

the

body

anything

eat

far

possible.

N-grams

long

good

the

body

anything

eat

far

possible.

long

good

anything

eat

long as

is good

Sentence 118) BLEU: 0.7598 (0.8333/0.8/0.75/0.6667) ; 0 (0.5/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.625/0.2857/0.1667/0) ; 0.7598 (0.8333/0.8/0.75/0.6667)

Source

�j��

��

�ɭ�

�}��

�H

Ref 0

When

the

antique

market?

Ref 1

When

the

market

for

antiques?

Ref 2

When

are

they

holding

the

antique

market?

Ref 3

When

the

antique

market

being

held?

Ref 4

What

time

the

antique

market?

Ref 5

When

does

the

antique

market

take

place?

Output 0

When

does

the

antique

market

open?

N-grams

When	does	the	antique	market	open?
When	does	the	antique	market
When does		the antique
When does the			antique market
When does the antique
	does the
	does the antique
	does the antique market
		the antique market

Output 1

market

when

the

does

open

N-grams

market	when	the	does	open	?
market		the	does

Output 2

Antiques

market

when

the

market

opened?

N-grams

Antiques	market	when	the	market	opened?
	market		the
			the market

Output 3

When

does

the

curio

market

open

for

business?

N-grams

When	does	the	curio	market	open	for	business?
When	does	the		market		for
When does
When does the
	does the

Output 4

When

does

the

antique

market

open?

N-grams

When	does	the	antique	market	open?
When	does	the	antique	market
When does		the antique
When does the			antique market
When does the antique
	does the
	does the antique
	does the antique market
		the antique market

Sentence 119) BLEU: 0 (0.4615/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.4615/0/0/0) ; 0 (0.7143/0.3333/0/0)

Source

��

�i�H

�K�

�a

�h��

��

�H

Ref 0

How

many

cigarettes

can

take

with

without

paying

duty?

Ref 1

How

many

cigarettes

allowed

take

with

without

paying

duty?

Ref 2

What

the

cigarette

allowance

before

would

have

start

paying

duty

taxes?

Ref 3

How

many

duty-free

cigarettes

can

bring

with

me?

Ref 4

How

many

cigarettes

can

take

with

duty-free?

Ref 5

How

many

cigarettes

can

take

with

without

paying

duty?

Output 0

How

much

does

cigarette

can

free

tax

bring

pay?

N-grams

How

much

does

cigarette

can

free

tax

bring

pay?

How

cigarette

can

bring

Output 1

tax-free

how

many

cigarette

can

bring

N-grams

tax-free	be	how	many	cigarette	can	bring	?
			many	cigarette	can	bring

Output 2

Cigarettes

tax-free

zone

could

how

many?

N-grams

Cigarettes

tax-free

zone

could

how

many?

Output 3

How

much

does

cigarette

can

free

tax

bring

pay?

N-grams

How

much

does

cigarette

can

free

tax

bring

pay?

How

cigarette

can

bring

Output 4

How

many

tax-free

can

the

cigarette

bring?

N-grams

How	many	tax-free	can	the	cigarette	bring?
How	many		can	the	cigarette
How many				the cigarette

Sentence 120) BLEU: 0 (0.2857/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3/0.1111/0/0) ; 0 (0.2857/0/0/0)

Source

��p

��{

�O

�h��

�H

Ref 0

What's

the

mileage

charge?

Ref 1

What's

the

charge

for

mileage?

Ref 2

How

much

have

pay

per

mile?

Ref 3

What

the

mileage

charge?

Ref 4

What's

the

mileage

fee?

Ref 5

What's

the

charge

per

mile?

Output 0

How

many

are

the

travel

course

expense?

N-grams

How	many	are	the	travel	course	expense?
How			the

Output 1

fee

how

N-grams

fee

how

Output 2

Mileage

fee?

N-grams

Mileage	fee?
	fee?

Output 3

How

much

driving

mile

distance

fee

N-grams

How	much	is	driving	a	mile	of	distance	fee	?
How	much	is
How much

Output 4

How

many

are

the

travel

course

expense?

N-grams

How	many	are	the	travel	course	expense?
How			the

Sentence 121) BLEU: 0 (0.625/0.2857/0.1667/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.625/0.2857/0.1667/0) ; 0 (0.1667/0/0/0)

Source

�z

�n

�A

��

�@

�i

�d

��

�H

Ref 0

Would

you

have

new

card?

Ref 1

Would

you

get

new

card?

Ref 2

you

want

new

card?

Ref 3

Would

you

want

new

card?

Ref 4

Would

you

new

card?

Ref 5

Would

you

receive

new

card?

Output 0

you

want

card

again?

N-grams

Do	you	want	to	do	a	card	again?
Do	you	want	to		a
Do you
Do you want
	you want

Output 1

you

want

card

again

N-grams

you	want	to	do	a	card	again	?
you	want	to		a
you want

Output 2

You

want

card?

N-grams

You	want	to	do	a	card?
	want	to		a	card?

Output 3

you

want

card

again?

N-grams

Do	you	want	to	do	a	card	again?
Do	you	want	to		a
Do you
Do you want
	you want

Output 4

You

must

make

card

again?

N-grams

You	must	make	a	card	again?
			a

Sentence 122) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0)

Source

�̭�

��

�H

Ref 0

What's

the

dish?

Ref 1

What

the

dish?

Ref 2

What

does

the

dish

contain?

Ref 3

What

ingredients

are

this

dish?

Ref 4

What

are

the

ingredients?

Ref 5

What

does

this

dish

contain?

Output 0

What's

inside?

N-grams

What's	inside?
What's

Output 1

what

inside

N-grams

what

inside

Output 2

What's

inside?

N-grams

What's	inside?
What's

Output 3

having

what?

N-grams

having

what?

Output 4

What

inside

has?

N-grams

What	inside	has?
What

Sentence 123) BLEU: 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

�O

�K�O

��

�H

Ref 0

free

charge?

Ref 1

free?

Ref 2

complimentary?

Ref 3

have

pay

for

it?

Ref 4

for

free?

Ref 5

free

charge?

Output 0

Are

free?

N-grams

Are	free?
	free?

Output 1

free

N-grams

free	is	?
free

Output 2

Are

free?

N-grams

Are	free?
	free?

Output 3

free?

N-grams

Is	free?
Is	free?

Output 4

free?

N-grams

Is	free?
Is	free?

Sentence 124) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�W��

�F

�C

Ref 0

feel

sleepy.

Ref 1

feel

tired.

Ref 2

drowsy.

Ref 3

I'm

very

tired.

Ref 4

I'm

sleepy.

Ref 5

I'm

feeling

sleepy.

Output 0

had

�\x95\xE7\x9D\xA1.

N-grams

I	had	�\x95\xE7\x9D\xA1.
I

Output 1

N-grams

Output 2

had磕睡.

N-grams

I	had磕睡.
I

Output 3

slept.

N-grams

slept.

Output 4

knocked

rest.

N-grams

I	knocked	rest.
I

Sentence 125) BLEU: 0 (0.6667/0.6/0/0) ; 0 (0.5714/0.5/0.2/0) ; 0 (0.6667/0.6/0/0) ; 0 (0.6667/0.6/0/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�i�D

��

�z

��

�ж��

�H

Ref 0

What

your

name

and

room

number?

Ref 1

What's

your

name

and

room

number?

Ref 2

What's

your

room

number

and

name?

Ref 3

Can

have

your

name

and

room

number?

Ref 4

What

your

name

and

room

number?

Ref 5

Give

your

name

and

room

number,

please.

Output 0

Please

tell

your

room

number?

N-grams

Please	tell	me	your	room	number?
		me	your	room	number?
		me your		room number?
			your room

Output 1

please

tell

your

room

number

N-grams

please	tell	me	your	room	number	?
		me	your	room	number
		me your		room number
			your room
			your room number

Output 2

Please

tell

your

room

number?

N-grams

Please	tell	me	your	room	number?
		me	your	room	number?
		me your		room number?
			your room

Output 3

Please

tell

your

room

number?

N-grams

Please	tell	me	your	room	number?
		me	your	room	number?
		me your		room number?
			your room

Output 4

Please

tell

you

the

room

number?

N-grams

Please	tell	me	you	the	room	number?
		me			room	number?
					room number?

Sentence 126) BLEU: 0 (0.5556/0.125/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.5556/0.125/0/0) ; 0 (0/0/0/0) ; 0 (0.7143/0/0/0)

Source

��

�C

��

�C

Ref 0

Five

dollars

horse

number

seven,

please.

Ref 1

Five

dollars

the

number

seven

horse,

please.

Ref 2

would

bet

five

dollars

horse

number

seven,

please.

Ref 3

want

put

five

dollars

horse

number

seven,

please.

Ref 4

Five

bucks

horse

number

seven,

please.

Ref 5

Five

dollars,

placed

horse

seven,

please.

Output 0

bet

the

7th

five

U.S.

dollars.

N-grams

I	bet	ma	on	the	7th	five	U.S.	dollars.
I	bet		on	the		five
			on the

Output 1

bet

five

dollars

N-grams

i	bet	five	dollars	.
	bet	five	dollars
	bet five
	bet five dollars
		five dollars

Output 2

bet

the

7th

five

U.S.

dollars.

N-grams

I	bet	Ma	on	the	7th	five	U.S.	dollars.
I	bet		on	the		five
			on the

Output 3

wager

No.7

Ma3

Wu3

USD.

N-grams

wager

No.7

Ma3

Wu3

USD.

Output 4

bet

seven

horse

five

dollars.

N-grams

I	bet	seven	horse	five	US	dollars.
I	bet	seven	horse	five

Sentence 127) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0)

Source

�\

��

�C

Ref 0

Don't

move.

Ref 1

not

move.

Ref 2

Stand

still.

Ref 3

Keep

still.

Ref 4

Stay

put.

Ref 5

Just

keep

still.

Output 0

Cannot

move.

N-grams

Cannot	move.
	move.

Output 1

move

N-grams

move

Output 2

不許動.

N-grams

不許動.

Output 3

Forbid

move.

N-grams

Forbid	to	move.
		move.

Output 4

Cannot

move.

N-grams

Cannot	move.
	move.

Sentence 128) BLEU: 0 (0.2857/0.1667/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�d�q��

�C

Ref 0

Thousand

Island,

please.

Ref 1

Thousand

Island

dressing,

please.

Ref 2

Thousand

Island,

please.

Ref 3

I'll

have

Thousand

Island

dressing,

please.

Ref 4

I'd

Thousand

Island,

please.

Ref 5

Thousand

Island,

please.

Output 0

Please

give

Thousand

Island

salad

sauce.

N-grams

Please	give	me	Thousand	Island	salad	sauce.
			Thousand	Island
			Thousand Island

Output 1

please

give

the

salad

sauce

thousand

island

N-grams

please

give

the

salad

sauce

thousand

island

Output 2

Please

give

the

Kuril

salad

sauce.

N-grams

Please

give

the

Kuril

salad

sauce.

Output 3

Please

give

thousand

colors

the

island

pull

sauce.

N-grams

Please

give

thousand

colors

the

island

pull

sauce.

Output 4

Please

give

thousand

island

salad

sauce.

N-grams

Please

give

thousand

island

salad

sauce.

Sentence 129) BLEU: 0 (0.2857/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2857/0/0/0)

Source

��

�H

Ref 0

Can

get

receipt?

Ref 1

Could

get

receipt?

Ref 2

May

have

the

receipt?

Ref 3

Could

have

receipt?

Ref 4

Could

have

the

receipt?

Ref 5

May

have

receipt?

Output 0

Can

give

the

bill

lading?

N-grams

Can	give	me	the	bill	of	lading?
Can			the

Output 1

water

can

give

N-grams

water

can

give

Output 2

Water

alone

can

give

it?

N-grams

Water

alone

can

give

it?

Output 3

canning

give

water

single?

N-grams

canning

give

water

single?

Output 4

Can

give

the

bill

lading?

N-grams

Can	give	me	the	bill	of	lading?
Can			the

Sentence 130) BLEU: 0 (0.375/0.1429/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.375/0.1429/0/0) ; 0 (0.2/0/0/0)

Source

��

�z

�t

�X

��

�a

�C

Ref 0

will

prescribe

some

medicine

for

you.

Ref 1

will

prescribe

you

some

medicine.

Ref 2

will

write

you

prescription

for

some

medication.

Ref 3

will

give

you

prescription

for

some

medication.

Ref 4

I'll

prescribe

you

some

medication.

Ref 5

I'll

prescribe

you

some

medicine.

Output 0

together

with

few

medicines

for

you.

N-grams

Go	together	with	a	few	medicines	for	you.
			a			for	you.
						for you.

Output 1

you

with

several

medicines

N-grams

to	you	with	several	medicines	.
	you

Output 2

you

with

several

medicine吧.

N-grams

To	you	with	several	medicine吧.
	you

Output 3

together

with

few

medicines

for

you.

N-grams

Go	together	with	a	few	medicines	for	you.
			a			for	you.
						for you.

Output 4

Matches

several

medicines

you.

N-grams

Matches	several	medicines	to	you.
				you.

Sentence 131) BLEU: 0 (0.4286/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.6/0/0/0)

Source

��

�z

��

�a

�C

Ref 0

Shall

take

the

photo

for

you?

Ref 1

Should

take

the

picture

for

you?

Ref 2

Would

you

take

the

snapshot

for

you?

Ref 3

Would

you

take

the

photo

for

you?

Ref 4

Would

you

take

the

picture

for

you?

Ref 5

Would

you

take

the

photograph

for

you?

Output 0

will

give

you

according

you.

N-grams

I	will	give	you	according	to	you.
I			you		to

Output 1

give

you

N-grams

i	give	you	to	.
		you	to

Output 2

will

give

you

according

you.

N-grams

I	will	give	you	according	to	you.
I			you		to

Output 3

shine

for

you.

N-grams

I	shine	on	for	you.
I			for

Output 4

give

you

illuminate.

N-grams

I	give	you	to	illuminate.
I		you	to

Sentence 132) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.3333/0/0) ; 0 (1/0/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.6/0.25/0/0)

Source

�{�b

�O

��

��l

�H

Ref 0

What's

this

song?

Ref 1

Which

song

this?

Ref 2

What

song

this?

Ref 3

you

know

the

name

this

song?

Ref 4

What

this

song?

Ref 5

What's

the

name

this

song?

Output 0

What

song

now?

N-grams

What	song	is	now?
What	song	is
What song
What song is
	song is

Output 1

what

song

N-grams

what	song	is	?
	song	is
	song is

Output 2

What

song?

N-grams

What	song?
What	song?

Output 3

What

song

now

N-grams

What	song	is	now	?
What	song	is
What song
What song is
	song is

Output 4

What

song

the

present

is?

N-grams

What	song	the	present	is?
What	song	the
What song

Sentence 133) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�g��

�F

�C

Ref 0

I'm

confused.

Ref 1

confused.

Ref 2

baffled.

Ref 3

puzzled.

Ref 4

I'm

confused.

Ref 5

I'm

confused.

Output 0

Get

lost.

N-grams

Get

lost.

Output 1

lost

N-grams

lost

Output 2

Lost.

N-grams

Lost.

Output 3

Get

lost.

N-grams

Get

lost.

Output 4

Became

lost.

N-grams

Became

lost.

Sentence 134) BLEU: 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.3333/0/0)

Source

��

�X

��

�H

Ref 0

How

many

people?

Ref 1

How

many

people

are

there?

Ref 2

How

many

persons?

Ref 3

How

many

people?

Ref 4

How

many

people?

Ref 5

How

many

people

altogether?

Output 0

How

many?

N-grams

How	many?
How

Output 1

how

many

N-grams

how	many	?
	many

Output 2

Have

few?

N-grams

Have

few?

Output 3

How

many?

N-grams

How	many?
How

Output 4

How

many

positions

has?

N-grams

How	many	positions	has?
How	many
How many

Sentence 135) BLEU: 1 (1/1/1/1) ; 0 (0.2/0/0/0) ; 0 (0.75/0.3333/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0/0/0)

Source

��

�i�H

��

�b

�o��

��

�H

Ref 0

May

sit

here?

Ref 1

Can

sit

here?

Ref 2

this

seat

taken?

Ref 3

you

mind

sit

here?

Ref 4

this

seat

free?

Ref 5

Would

you

mind

sit

here?

Output 0

Can

sit

here?

N-grams

Can	I	sit	here?
Can	I	sit	here?
Can I		sit here?
Can I sit
Can I sit here?
	I sit
	I sit here?

Output 1

can

sit

here

N-grams

i	can	sit	here	?
		sit

Output 2

can

sit

here?

N-grams

I	can	sit	here?
I		sit	here?
		sit here?

Output 3

Can

sit

here?

N-grams

Can	I	sit	here?
Can	I	sit	here?
Can I		sit here?
Can I sit
Can I sit here?
	I sit
	I sit here?

Output 4

may

sit

here?

N-grams

I	may	sit	in	here?
I		sit		here?

Sentence 136) BLEU: 0 (0.1429/0/0/0) ; 0 (0.1111/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1/0/0/0)

Source

��

�T

��

�M

�o��

�@��

��

�C

Ref 0

I'll

take

three

these.

Ref 1

will

take

three

these.

Ref 2

would

three

these.

Ref 3

I'll

take

three

these.

Ref 4

I'll

take

three

these.

Ref 5

I'd

three

these.

Output 0

Please

give

three

and

the

same.

N-grams

Please	give	me	three	and	the	same.
			three

Output 1

please

give

three

the

same

this

N-grams

please	give	me	three	the	same	to	this	.
			three

Output 2

Please

give

three

and

the

same.

N-grams

Please	give	me	three	and	the	same.
			three

Output 3

Please

give

threes

similar

this.

N-grams

Please

give

threes

similar

this.

Output 4

Please

give

three

the

same

with

this.

N-grams

Please	give	me	three	to	be	the	same	with	this.
			three

Sentence 137) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.4/0.25/0/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�o

��

�ޱ�

�C

Ref 0

want

have

this

tooth

pulled

out.

Ref 1

would

have

this

tooth

pulled

out.

Ref 2

would

have

this

tooth

extracted.

Ref 3

I'd

have

this

tooth

pulled

out.

Ref 4

want

have

this

tooth

removed.

Ref 5

want

have

this

tooth

extracted.

Output 0

Please

send

this

tooth

pulled

out.

N-grams

Please	send	this	tooth	pulled	out.
		this	tooth	pulled	out.
		this tooth		pulled out.
		this tooth pulled
		this tooth pulled out.
			tooth pulled
			tooth pulled out.

Output 1

please

this

tooth

out

N-grams

please	this	tooth	out	.
	this	tooth
	this tooth

Output 2

Please

send

this

tooth

pulled

out.

N-grams

Please	send	this	tooth	pulled	out.
		this	tooth	pulled	out.
		this tooth		pulled out.
		this tooth pulled
		this tooth pulled out.
			tooth pulled
			tooth pulled out.

Output 3

Please

pull

out

this

tooth.

N-grams

Please	pull	out	this	tooth.
			this

Output 4

Please

capture

this

tooth.

N-grams

Please	capture	this	tooth.
		this

Sentence 138) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�F

�C

Ref 0

That's

done.

Ref 1

That's

finished.

Ref 2

That

finished.

Ref 3

That's

done.

Ref 4

That's

over.

Ref 5

That's

taken

care

of.

Output 0

Finished.

N-grams

Finished.

Output 1

end

N-grams

end

Output 2

End.

N-grams

End.

Output 3

End.

N-grams

End.

Output 4

Finished.

N-grams

Finished.

Sentence 139) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

�S��

�w�q

�L

�i�H

��

�H

Ref 0

don't

have

reservation,

but

that

okay?

Ref 1

not

have

reservation,

but

that

okay?

Ref 2

haven't

got

booking,

but

alright?

Ref 3

didn't

make

reservation,

but

okay?

Ref 4

don't

have

reservation,

that

okay?

Ref 5

okay

that

don't

have

reservation?

Output 0

reservations

have

been

possible?

N-grams

No	reservations	have	been	possible?
		have

Output 1

been

possible

N-grams

been

possible

Output 2

reservations

have

been

possible?

N-grams

No	reservations	have	been	possible?
		have

Output 3

Having

never

reserved

can?

N-grams

Having

never

reserved

can?

Output 4

Has

not

ordered

has

been

possible?

N-grams

Has	not	ordered	has	been	possible?
	not

Sentence 140) BLEU: 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0)

Source

��W�n

�C

Ref 0

Good

morning,

sir.

Ref 1

Good

morning,

sir.

Ref 2

Good

morning,

sir.

Ref 3

Good

morning,

sir.

Ref 4

Good

morning,

sir.

Ref 5

Good

morning

you,

sir.

Output 0

Good

morning.

N-grams

Good	morning.
Good

Output 1

good

morning

the

N-grams

good	morning	in	the	.
	morning

Output 2

Good

morning.

N-grams

Good	morning.
Good

Output 3

Good

the

morning.

N-grams

Good	in	the	morning.
Good

Output 4

the

morning

good.

N-grams

In	the	morning	is	good.
		morning

Sentence 141) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��Ť

�F

�C

Ref 0

hard

hearing.

Ref 1

bit

deaf.

Ref 2

slightly

deaf.

Ref 3

don't

hear

very

well.

Ref 4

I'm

hard

hearing.

Ref 5

little

deaf.

Output 0

Deafness

had.

N-grams

Deafness

had.

Output 1

deafness

N-grams

deafness

Output 2

Deafness

had.

N-grams

Deafness

had.

Output 3

Deaf.

N-grams

Deaf.

Output 4

Deafness.

N-grams

Deafness.

Sentence 142) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0)

Source

��

�i�H

�l��

��

�H

Ref 0

you

mind

smoke?

Ref 1

Would

you

mind

smoked?

Ref 2

Does

bother

you

smoke?

Ref 3

Will

bother

you

have

cigarette?

Ref 4

okay

with

you

smoke?

Ref 5

Would

you

object

smoke?

Output 0

Can

smoke

here?

N-grams

Can	I	smoke	here?
	I

Output 1

can

smoke

N-grams

can

smoke

Output 2

Can

smoke

here?

N-grams

Can	I	smoke	here?
	I

Output 3

Can

smoke

cigarette?

N-grams

Can	I	smoke	cigarette?
	I		cigarette?

Output 4

may

smoke?

N-grams

I	may	smoke?
I		smoke?

Sentence 143) BLEU: 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�O

�H

Ref 0

How

would

you

it?

Ref 1

How

would

you

it?

Ref 2

How

you

want

it?

Ref 3

How

would

you

it?

Ref 4

How

would

you

it?

Ref 5

How

would

you

that?

Output 0

How

can

do?

N-grams

How	can	I	do?
How

Output 1

how

should

N-grams

how	i	do	should	?
		do

Output 2

How

can

do?

N-grams

How	can	I	do?
How

Output 3

How

should

do?

N-grams

How	should	I	do?
How

Output 4

How

should

manage?

N-grams

How	should	I	manage?
How

Sentence 144) BLEU: 0 (0.375/0.1429/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.375/0.1429/0/0) ; 0 (0.1667/0/0/0)

Source

�A��

�@��

�h��

�H

Ref 0

How

many

are

there

your

party,

sir?

Ref 1

How

many

people

are

your

party,

sir?

Ref 2

How

big

your

party,

sir?

Ref 3

How

many

are

there

your

party,

sir?

Ref 4

How

many

are

there

your

party,

sir?

Ref 5

How

many

are

there

your

party,

sir?

Output 0

How

many

persons

are

you

line

of?

N-grams

How	many	persons	are	you	a	line	of?
How	many		are
How many

Output 1

you

how

many

people

line

N-grams

you	how	many	people	line	of	?
		many	people
		many people

Output 2

You

how

many

people

and

his

party?

N-grams

You	how	many	people	and	his	party?
		many	people
		many people

Output 3

How

many

persons

are

you

line

of?

N-grams

How	many	persons	are	you	a	line	of?
How	many		are
How many

Output 4

Your

line

how

many

people?

N-grams

Your	line	of	how	many	people?
				many

Sentence 145) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

��J

�C

Ref 0

Scrambled,

please.

Ref 1

Please,

scrambled.

Ref 2

Scrambled,

please.

Ref 3

Scrambled,

please.

Ref 4

Scrambled,

please.

Ref 5

I'd

scrambled,

please.

Output 0

Please

give

scrambled

eggs.

N-grams

Please

give

scrambled

eggs.

Output 1

please

fry

egg

N-grams

please

fry

egg

Output 2

Please

give

scrambled

eggs.

N-grams

Please

give

scrambled

eggs.

Output 3

Please

fry

egg

for

me.

N-grams

Please

fry

egg

for

me.

Output 4

Please

fry

the

egg

me.

N-grams

Please

fry

the

egg

me.

Sentence 146) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0)

Source

�b

��

�H

Ref 0

Where?

Ref 1

Where?

Ref 2

Which

place?

Ref 3

Where?

Ref 4

Where?

Ref 5

Can

you

tell

where?

Output 0

Where

did

you

meet

it?

N-grams

Where	did	you	meet	it?
		you

Output 1

where

meet

N-grams

where

meet

Output 2

Where

meet?

N-grams

Where

meet?

Output 3

Where

did

you

meet

N-grams

Where	did	you	meet	it	?
		you

Output 4

Where

meets?

N-grams

Where

meets?

Sentence 147) BLEU: 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.3333/0/0)

Source

��

�y��

�C

Ref 0

Please

wait

seated.

Ref 1

Please

wait

seated.

Ref 2

Please

wait

seated.

Ref 3

Please

wait

for

the

hostess

seat

you.

Ref 4

Please

wait

for

the

hostess.

Ref 5

Please

wait

and

someone

will

seat

you.

Output 0

Please

wait.

N-grams

Please	wait.
Please

Output 1

please

wait

N-grams

please	wait	.
	wait

Output 2

Please

wait.

N-grams

Please	wait.
Please

Output 3

Please

slightly

wait

for.

N-grams

Please	slightly	wait	for.
Please		wait

Output 4

Please

wait

bit.

N-grams

Please	wait	a	bit.
Please	wait
Please wait

Sentence 148) BLEU: 0 (0.2/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.8/0/0/0) ; 0 (0.2/0/0/0)

Source

�{�b

��

�w�q

��

�H

Ref 0

Can

change

reservation

now?

Ref 1

Could

change

reservation

now?

Ref 2

May

change

booking

now?

Ref 3

Could

make

change

reservation

now?

Ref 4

possible

change

reservation

now?

Ref 5

May

change

reservation

now?

Output 0

Now

can

change

the

reservation?

N-grams

Now	can	change	the	reservation?
		change

Output 1

now

change

the

can

N-grams

now	change	the	can	?
	change

Output 2

Now

change

the

booking?

N-grams

Now	change	the	booking?
	change

Output 3

Can

change

reserve

now?

N-grams

Can	change	to	reserve	now?
Can	change	to		now?

Output 4

Now

can

change

the

reservation?

N-grams

Now	can	change	the	reservation?
		change

Sentence 149) BLEU: 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0)

Source

�z�L

�F

��

�ײz

��

�H

Ref 0

Could

you

repair

the

flat

tire,

please?

Ref 1

Please,

could

you

repair

the

flat

tire?

Ref 2

Could

you

fix

the

puncture,

please?

Ref 3

Could

you

please

repair

flat

tire?

Ref 4

Could

you

repair

the

flat,

please?

Ref 5

Could

you

fix

the

flat

tire,

please?

Output 0

Puncture

has

been

able

repair

it?

N-grams

Puncture	has	been	able	to	repair	it?
					repair

Output 1

has

been

able

repair

N-grams

has	been	able	to	repair	?
				repair

Output 2

Puncture

has

been

able

repair

it?

N-grams

Puncture	has	been	able	to	repair	it?
					repair

Output 3

Can

having

flat

tire

fix?

N-grams

Can	having	a	flat	tire	fix?
			flat

Output 4

The

blowout

has

been

able

repair?

N-grams

The

blowout

has

been

able

repair?

Sentence 150) BLEU: 0 (0.25/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.25/0/0/0) ; 0 (0.375/0.1429/0/0)

Source

�i�H

��

�餸

�I��

��

�H

Ref 0

Can

pay

Japanese

Yen?

Ref 1

Could

pay

Japanese

Yen?

Ref 2

you

Japanese

Yen?

Ref 3

Would

okay

pay

Japanese

Yen?

Ref 4

you

take

Japanese

Yen?

Ref 5

Can

pay

with

Japanese

Yen?

Output 0

all

right

use

yen

payment?

N-grams

Is	it	all	right	to	use	yen	payment?
	it			to

Output 1

use

the

yen

pay

N-grams

use	the	yen	to	pay	it	?
			to	pay	it
			to pay

Output 2

Can

use

the

yen

pay

it?

N-grams

Can	use	the	yen	to	pay	it?
Can				to	pay
				to pay

Output 3

all

right

use

yen

payment?

N-grams

Is	it	all	right	to	use	yen	payment?
	it			to

Output 4

May

use

the

Japanese

Yen

pay

money?

N-grams

May	use	the	Japanese	Yen	to	pay	money?
			Japanese		to	pay
					to pay

Sentence 151) BLEU: 0.2985 (0.4444/0.375/0.2857/0.1667) ; 0.2985 (0.4444/0.375/0.2857/0.1667) ; 0.2985 (0.4444/0.375/0.2857/0.1667) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0.4347 (0.7143/0.5/0.4/0.25)

Source

��

�@

�~

�q�u��

��

�H

Ref 0

May

have

bottle

mineral

water?

Ref 1

Could

have

bottle

mineral

water?

Ref 2

would

bottle

mineral

water.

Ref 3

Can

have

bottle

mineral

water?

Ref 4

May

have

bottle

mineral

water?

Ref 5

Can

have

bottle

mineral

water,

please.

Output 0

Give

bottle

mineral

water

it?

N-grams

Give	me	a	bottle	of	mineral	water	in	it?
		a	bottle	of	mineral
		a bottle		of mineral
		a bottle of
		a bottle of mineral
			bottle of
			bottle of mineral

Output 1

give

bottle

mineral

water

can

N-grams

give	me	a	bottle	of	mineral	water	can	?
		a	bottle	of	mineral
		a bottle		of mineral
		a bottle of
		a bottle of mineral
			bottle of
			bottle of mineral

Output 2

Give

bottle

mineral

water

it?

N-grams

Give	me	a	bottle	of	mineral	water	in	it?
		a	bottle	of	mineral
		a bottle		of mineral
		a bottle of
		a bottle of mineral
			bottle of
			bottle of mineral

Output 3

Can

give

bottle

mineral

spring?

N-grams

Can	give	me	a	bottle	of	mineral	spring?
Can			a	bottle	of	mineral
			a bottle		of mineral
			a bottle of
			a bottle of mineral
				bottle of
				bottle of mineral

Output 4

Can

give

bottle

mineral

water?

N-grams

Can	give	me	bottle	of	mineral	water?
Can			bottle	of	mineral	water?
			bottle of		mineral water?
			bottle of mineral
			bottle of mineral water?
				of mineral
				of mineral water?

Sentence 152) BLEU: 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0)

Source

�Q

��

�F

�C

Ref 0

was

hit

car.

Ref 1

car

hit

me.

Ref 2

was

run

over

car.

Ref 3

was

hit

car.

Ref 4

was

hit

car.

Ref 5

was

hit

car.

Output 0

was

bumped

the

car.

N-grams

It	was	bumped	by	the	car.
	was		by		car.

Output 1

N-grams

by	.
by

Output 2

Been

hit

cars.

N-grams

Been	hit	by	cars.
	hit	by
	hit by

Output 3

was

bumped

the

car.

N-grams

It	was	bumped	by	the	car.
	was		by		car.

Output 4

Che

Zhuang.

N-grams

Che

Zhuang.

Sentence 153) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�ΪA

��

�H

Ref 0

What's

wrong?

Ref 1

What's

the

problem?

Ref 2

What's

up?

Ref 3

there

problem?

Ref 4

What's

the

matter?

Ref 5

What's

wrong?

Output 0

Where

uncomfortable?

N-grams

Where

uncomfortable?

Output 1

where

uncomfortable

N-grams

where

uncomfortable

Output 2

Where

are

uncomfortable

ah?

N-grams

Where

are

uncomfortable

ah?

Output 3

Where

uncomfortable?

N-grams

Where

uncomfortable?

Output 4

Where

uncomfortable?

N-grams

Where

uncomfortable?

Sentence 154) BLEU: 0 (0.2857/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0)

Source

�}��

�a

��n

��

�C

Ref 0

You're

joking.

Ref 1

You're

kidding.

Ref 2

You've

got

kidding.

Ref 3

You've

got

joking.

Ref 4

You're

joking.

Ref 5

You're

not

serious,

are

you?

Output 0

not

make

fun

kidding.

N-grams

Do	not	make	fun	of	me	kidding.
	not					kidding.

Output 1

not

N-grams

do	not	me	.
	not

Output 2

not

make

fun

kidding.

N-grams

Do	not	make	fun	of	me	kidding.
	not					kidding.

Output 3

Play

trick

don't

laugh

me.

N-grams

Play

trick

don't

laugh

me.

Output 4

Cracks

joke

not

tease

me.

N-grams

Cracks	a	joke	do	not	tease	me.
				not

Sentence 155) BLEU: 0 (0.3333/0.125/0/0) ; 0 (0.4/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.375/0.2857/0/0) ; 0 (0.3333/0.125/0/0)

Source

��

��§�A

��

��a

�C

Ref 0

It's

black

tie.

Ref 1

black

tie.

Ref 2

It's

black

tie.

Ref 3

very

formal.

Ref 4

It's

black

tie.

Ref 5

It's

black

tie

affair.

Output 0

Puts

the

evening

dress

the

black

tie.

N-grams

Puts	on	the	evening	dress	is	the	black	tie.
					is		black	tie.
							black tie.

Output 1

black

evening

dress

tie

N-grams

black	evening	dress	tie	.
black			tie

Output 2

Department

black

evening

dress

tie.

N-grams

Department	of	black	evening	dress	tie.
		black			tie.

Output 3

Wear

evening

dress

fasten

black

tie.

N-grams

Wear	evening	dress	to	fasten	a	black	tie.
					a	black	tie.
					a black
						black tie.

Output 4

Puts

the

evening

dress

the

black

tie.

N-grams

Puts	on	the	evening	dress	is	the	black	tie.
					is		black	tie.
							black tie.

Sentence 156) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�藍�_

�C

Ref 0

Excuse

me.

Ref 1

Pardon

me.

Ref 2

Excuse

me.

Ref 3

Excuse

me.

Ref 4

Excuse

me.

Ref 5

Oh,

please

excuse

me.

Output 0

Sorry.

N-grams

Sorry.

Output 1

N-grams

Output 2

對不起.

N-grams

對不起.

Output 3

Sorry.

N-grams

Sorry.

Output 4

Being

unfair.

N-grams

Being

unfair.

Sentence 157) BLEU: 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0/0/0/0)

Source

�z

�Ѯa

�b

��

�H

Ref 0

Where

you

come

from?

Ref 1

Where

are

you

from?

Ref 2

Where

you

come

from?

Ref 3

Where

you

come

from?

Ref 4

Where

you

hail

from?

Ref 5

Where

you

come

from?

Output 0

Where

the

your

old

house?

N-grams

Where	is	the	your	old	house?
Where

Output 1

where

your

N-grams

where

your

Output 2

Where

your

hometown?

N-grams

Where	is	your	hometown?
Where

Output 3

Where

the

your

old

house

N-grams

Where	is	the	your	old	house	?
Where

Output 4

Your

native

place

where?

N-grams

Your

native

place

where?

Sentence 158) BLEU: 0 (0.2222/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.125/0/0/0)

Source

�o��

�q�l

�l��

�a�}

��

�l��

��

�H

Ref 0

Can

receive

this

address?

Ref 1

Can

receive

this

address?

Ref 2

Can

get

this

address?

Ref 3

possible

for

receive

e-mail

this

address?

Ref 4

Can

receive

this

address?

Ref 5

Can

receive

this

address?

Output 0

Can

this

address

the

Electronics

mail

mail?

N-grams

Can	this	address	of	the	Electronics	mail	accept	mail?
Can	this

Output 1

this

address

mail

can

the

mail

N-grams

this	address	of	mail	can	the	mail	?
this

Output 2

This

e-mail

address

incoming

mail

it?

N-grams

This	e-mail	address	of	incoming	mail	to	it?
	e-mail					to

Output 3

Can

this

address

the

electronics

mail

mail?

N-grams

Can	this	address	of	the	electronics	mail	accept	mail?
Can	this

Output 4

This

electronic

mail

address

can

receive

the

mail?

N-grams

This	electronic	mail	address	can	receive	the	mail?
					receive

Sentence 159) BLEU: 0 (0.2857/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.5/0.2/0/0)

Source

��

�@�U

��

�C

Ref 0

Show

me,

please.

Ref 1

Please

show

me.

Ref 2

May

see

it,

please?

Ref 3

Can

please

see

it?

Ref 4

Let

see

it,

please.

Ref 5

Will

you

show

me,

please?

Output 0

Please

give

look

that.

N-grams

Please	give	me	a	look	at	that.
Please		me

Output 1

please

look

that

N-grams

please	me	a	look	at	that	.
please	me

Output 2

Please

give

look

that.

N-grams

Please	give	me	a	look	at	that.
Please		me

Output 3

Please

take

look

that

for

me.

N-grams

Please	take	a	look	that	for	me.
Please						me.

Output 4

Please

look

that

me.

N-grams

Please	look	at	that	to	me.
Please				to	me.
				to me.

Sentence 160) BLEU: 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0)

Source

�i�H

�M

�F

��

�H

Ref 0

May

take

your

plates?

Ref 1

Can

take

your

plates?

Ref 2

May

have

your

plates?

Ref 3

Are

you

all

through?

Ref 4

Could

remove

your

plates?

Ref 5

May

remove

your

plates?

Output 0

all

right

withdraw?

N-grams

Is	it	all	right	to	withdraw?
		all

Output 1

withdraw

N-grams

withdraw

Output 2

Can

withdraw

it?

N-grams

Can	withdraw	it?
Can

Output 3

all

right

withdraw?

N-grams

Is	it	all	right	to	withdraw?
		all

Output 4

Has

been

possible

remove?

N-grams

Has

been

possible

remove?

Sentence 161) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�n

�F

�C

Ref 0

Wonderful.

Ref 1

Great.

Ref 2

Wonderful.

Ref 3

Wonderful.

Ref 4

Wonderful.

Ref 5

Wonderful.

Output 0

Wonderful.

N-grams

Wonderful.

Output 1

too

N-grams

too

Output 2

Wonderful.

N-grams

Wonderful.

Output 3

Liked

too

much.

N-grams

Liked

too

much.

Output 4

Too

good.

N-grams

Too

good.

Sentence 162) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�

�O

�t�~

��

�C

Ref 0

No,

without

tax.

Ref 1

No,

without

tax.

Ref 2

No,

excluding

tax.

Ref 3

No,

without

tax.

Ref 4

No,

tax-free.

Ref 5

No,

that's

without

tax.

Output 0

The

tax

not

other.

N-grams

The

tax

not

other.

Output 1

not

tax

the

N-grams

not

tax

the

Output 2

not

tax

additional.

N-grams

not

tax

additional.

Output 3

Not

the

tax

another.

N-grams

Not

the

tax

another.

Output 4

The

tax

not

other.

N-grams

The

tax

not

other.

Sentence 163) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�i�H

�C

Ref 0

No,

thank

you.

Ref 1

No,

thank

you.

Ref 2

No,

thank

you.

Ref 3

No,

thanks.

Ref 4

No,

thanks

anyway.

Ref 5

Thank

you,

but

no.

Output 0

May.

N-grams

May.

Output 1

N-grams

Output 2

可以.

N-grams

可以.

Output 3

Can.

N-grams

Can.

Output 4

May.

N-grams

May.

Sentence 164) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (1/0.5/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.4/0.25/0/0)

Source

��

�H

Ref 0

you

have

any

vegetable

soup?

Ref 1

you

have

some

vegetable

soup?

Ref 2

Have

you

got

any

vegetable

soup?

Ref 3

you

have

any

vegetable

soup?

Ref 4

Have

you

got

some

vegetable

soup?

Ref 5

you

have

vegetable

soup

available?

Output 0

there

vegetable

soup?

N-grams

Is	there	vegetable	soup?
		vegetable	soup?
		vegetable soup?

Output 1

vegetable

soup

N-grams

vegetable	soup	?
vegetable	soup
vegetable soup

Output 2

Have

vegetable

soup?

N-grams

Have	vegetable	soup?
Have	vegetable	soup?
	vegetable soup?

Output 3

there

vegetable

soup?

N-grams

Is	there	vegetable	soup?
		vegetable	soup?
		vegetable soup?

Output 4

Has

the

vegetables

vegetable

soup?

N-grams

Has	the	vegetables	vegetable	soup?
			vegetable	soup?
			vegetable soup?

Sentence 165) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�n

�O

�H

Ref 0

Whom

should

ask?

Ref 1

Who

should

ask?

Ref 2

Whom

should

ask?

Ref 3

Who

can

ask?

Ref 4

Whom

should

ask?

Ref 5

Who

the

best

person

ask?

Output 0

Asked

that

who

good?

N-grams

Asked	that	who	is	good?
			is

Output 1

ask

who

good

N-grams

ask

who

good

Output 2

Ask

then?

N-grams

Ask

then?

Output 3

Ask

who

good?

N-grams

Ask

who

good?

Output 4

Asked

that

who

good?

N-grams

Asked	that	who	is	good?
			is

Sentence 166) BLEU: 0.3656 (0.625/0.4286/0.3333/0.2) ; 0 (0.375/0/0/0) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0 (0.1111/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�h��

��

�i�D

��

�C

Ref 0

Please

let

know

there

cancellation.

Ref 1

there

cancellation,

please

let

know.

Ref 2

Can

you

please

let

know

there's

cancellation?

Ref 3

Inform

there

cancellation,

please?

Ref 4

Please

contact

there's

cancellation.

Ref 5

Please

let

know

there

are

any

cancellations.

Output 0

Have

refund,

then

please

let

know.

N-grams

Have	a	refund,	then	please	let	me	know.
	a			please	let	me	know.
				please let		me know.
				please let me
				please let me know.
					let me
					let me know.

Output 1

please

the

words

tell

N-grams

a	,	please	me	the	words	tell	.
a		please	me

Output 2

Have

refund,

then

please

let

know.

N-grams

Have	a	refund,	then	please	let	me	know.
	a			please	let	me	know.
				please let		me know.
				please let me
				please let me know.
					let me
					let me know.

Output 3

The

words

with

dishonor

bill

tell

me,

please.

N-grams

The	words	with	a	dishonor	bill	tell	me,	please.
			a

Output 4

Has

the

returning

ticket

words

please

tell

me.

N-grams

Has	the	returning	a	ticket	words	please	to	tell	me.
			a			please

Sentence 167) BLEU: 0 (0.4545/0.1/0/0) ; 0 (0.4545/0.1/0/0) ; 0 (0.4545/0.1/0/0) ; 0 (0.4615/0.1667/0/0) ; 0 (0.5556/0.125/0/0)

Source

��

�@�U

��

�u

�K�⦡

�x��

�n

��

�H

Ref 0

Will

you

show

that

traveling

alarm

clock?

Ref 1

Would

you

show

the

traveling

alarm

clock?

Ref 2

May

have

look

that

traveling

alarm

clock?

Ref 3

Can

see

that

traveling

alarm

clock?

Ref 4

Will

you

show

that

travel

alarm

clock?

Ref 5

Would

you

show

that

travel

alarm

clock?

Output 0

Please

give

look

only

portable

alarm

clock,

please?

N-grams

Please	give	me	a	look	only	a	portable	alarm	clock,	please?
		me	a	look				alarm
			a look

Output 1

please

look

only

portable

alarm

clock

that

N-grams

please	me	a	look	only	portable	alarm	clock	that	to	?
	me	a	look			alarm		that
		a look

Output 2

Please

give

look

only

portable

alarm

clock,

please?

N-grams

Please	give	me	a	look	only	a	portable	alarm	clock,	please?
		me	a	look				alarm
			a look

Output 3

Please

take

look

that

only

then

hold

type

alarm

clock?

N-grams

Please

take

look

that

only

then

hold

type

alarm

clock?

look

that

alarm

clock?

a look

alarm clock?

Output 4

Please

look

that

only

portable

alarm

clock?

N-grams

Please	to	me	look	that	only	portable	alarm	clock?
		me	look	that			alarm	clock?
							alarm clock?

Sentence 168) BLEU: 0 (0.2/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.2/0/0/0)

Source

��W�n

�C

�O

�s��

�A��

�C

Ref 0

Good

morning.
This

your

morning

call.

Ref 1

Good

morning.
This

your

morning

wake-up

call.

Ref 2

Good

morning.
This

your

wake-up

call.

Ref 3

Good

morning.
This

your

morning

call.

Ref 4

Good

morning.
This

your

morning

call.

Ref 5

Good

morning.
This

your

morning

call..

Output 0

the

morning

good.

calls

serve

early.

N-grams

In	the	morning	is	good.	Is	calls	to	serve	early.
		morning	is

Output 1

good

morning

early

the

serve

N-grams

good	morning	early	in	the	to	serve	.
	morning

Output 2

Good

morning.

Services

are

called

early.

N-grams

Good	morning.	Services	are	called	early.
Good	morning.
Good morning.

Output 3

Good

the

morning.

call

serve

early.

N-grams

Good	in	the	morning.	BE	call	to	serve	early.
Good			morning.

Output 4

the

morning

good.

calls

serve

early.

N-grams

In	the	morning	is	good.	Is	calls	to	serve	early.
		morning	is

Sentence 169) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.8/0.25/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.4/0/0/0)

Source

�Q

�n

�O�D�G

�C

Ref 0

I'd

buy

shower

gel.

Ref 1

would

buy

some

shower

gel.

Ref 2

want

buy

shower

gel.

Ref 3

would

purchase

some

liquid

shower

soap.

Ref 4

would

buy

shower

gel.

Ref 5

I'd

buy

some

shower

gel.

Output 0

Want

take

shower

bath

liquid.

N-grams

Want	to	take	a	shower	bath	a	liquid.
	to		a	shower
			a shower

Output 1

want

shower

liquid

N-grams

want	to	shower	liquid	.
want	to	shower	liquid
want to

Output 2

Want

shower

liquid.

N-grams

Want	to	shower	liquid.
	to	shower

Output 3

Want

take

shower

bath

liquid.

N-grams

Want	to	take	a	shower	bath	a	liquid.
	to		a	shower
			a shower

Output 4

Wants

shower

the

fluid.

N-grams

Wants	to	shower	the	fluid.
	to	shower

Sentence 170) BLEU: 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (1/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�H

Ref 0

you

have

your

claim

tag?

Ref 1

you

have

your

claim

tag?

Ref 2

Have

you

got

your

claim

ticket?

Ref 3

you

have

your

baggage

claim

tag?

Ref 4

you

have

your

claim

ticket?

Ref 5

you

have

your

claim

tag

available?

Output 0

there

baggage

ticket?

N-grams

Is	there	baggage	ticket?
		baggage	ticket?

Output 1

baggage

ticket

N-grams

baggage	ticket	?
baggage

Output 2

Have

baggage

ticket?

N-grams

Have	baggage	ticket?
Have	baggage	ticket?

Output 3

there

baggage

ticket?

N-grams

Is	there	baggage	ticket?
		baggage	ticket?

Output 4

Has

the

baggage

check?

N-grams

Has	the	baggage	check?
		baggage

Sentence 171) BLEU: 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0)

Source

��]

�Q

��

�F

�C

Ref 0

had

wallet

stolen.

Ref 1

wallet

was

stolen.

Ref 2

wallet

has

been

stolen.

Ref 3

wallet

was

taken.

Ref 4

had

wallet

taken.

Ref 5

had

wallet

stolen.

Output 0

The

wallet

stolen.

N-grams

The	wallet	is	stolen.
	wallet		stolen.

Output 1

wallet

stolen

the

N-grams

wallet	stolen	the	is	.
wallet

Output 2

Wallet

was

stolen.

N-grams

Wallet	was	stolen.
	was	stolen.
	was stolen.

Output 3

The

purse

stolen.

N-grams

The	purse	is	stolen.
			stolen.

Output 4

The

wallet

stolen.

N-grams

The	wallet	is	stolen.
	wallet		stolen.

Sentence 172) BLEU: 0 (0.3333/0.2/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.4286/0.3333/0.2/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.2857/0/0/0)

Source

��

�A

��

�C

Ref 0

don't

understand.

Ref 1

not

understand.

Ref 2

not

comprehend.

Ref 3

don't

get

it.

Ref 4

don't

follow.

Ref 5

I'm

sorry

but

don't

understand.

Output 0

don't

understand

what

you

say.

N-grams

I	don't	understand	what	you	say.
I	don't
I don't

Output 1

not

understand

what

you

say

N-grams

i	not	understand	what	you	say	.
	not

Output 2

not

understand

what

you

say.

N-grams

I	do	not	understand	what	you	say.
I	do	not
I do
I do not
	do not

Output 3

don't

understand

what

you

say.

N-grams

I	don't	understand	what	you	say.
I	don't
I don't

Output 4

did

not

understand

that

you

said.

N-grams

I	did	not	understand	that	you	said.
I		not

Sentence 173) BLEU: 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 0 (1/0/0/0) ; 1 (1/1/1/1) ; 0 (0/0/0/0)

Source

�P��@

��

�C

Ref 0

See

you

Monday.

Ref 1

See

you

Monday.

Ref 2

I'll

see

you

Monday.

Ref 3

See

you

Monday.

Ref 4

I'll

see

you

Monday.

Ref 5

See

you

Monday.

Output 0

See

you

Monday.

N-grams

See	you	on	Monday.
See	you	on	Monday.
See you		on Monday.
See you on
See you on Monday.
	you on
	you on Monday.

Output 1

see

monday

N-grams

see	monday	.
see

Output 2

See

Monday.

N-grams

See	Monday.
See	Monday.

Output 3

See

you

Monday.

N-grams

See	you	on	Monday.
See	you	on	Monday.
See you		on Monday.
See you on
See you on Monday.
	you on
	you on Monday.

Output 4

Monday

sees.

N-grams

Monday

sees.

Sentence 174) BLEU: 0 (0.3636/0.1/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4545/0.1/0/0) ; 0 (0.3636/0.1/0/0) ; 0 (0.5455/0.3/0.1111/0)

Source

��

�O�o

��

�n

�L

�ȩ�

�A��

�C

Ref 0

didn't

order

room

service.

Ref 1

did

not

order

room

service.

Ref 2

did

not

ask

for

room

service.

Ref 3

didn't

ask

for

room

service.

Ref 4

didn't

order

room

service.

Ref 5

didn't

place

order

with

room

service.

Output 0

don't

remember

that

once

wanted

guest

room

service.

N-grams

I	don't	remember	that	I	once	wanted	a	guest	room	service.
I									room	service.
									room service.

Output 1

not

remember

guest

room

service

that

wanted

N-grams

i	not	remember	i	guest	room	service	that	wanted	.
	not				room

Output 2

not

remember

would

guest

room

service.

N-grams

I	do	not	remember	I	would	like	to	guest	room	service.
I		not							room	service.
									room service.

Output 3

don't

remember

that

once

wanted

guest

room

service.

N-grams

I	don't	remember	that	I	once	wanted	a	guest	room	service.
I									room	service.
									room service.

Output 4

did

not

remember

that

have

wanted

the

room

service.

N-grams

I	did	not	remember	that	I	have	wanted	the	room	service.
I	did	not							room	service.
I did									room service.
I did not
	did not

Sentence 175) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0)

Source

�N��

�b��

�C

Ref 0

It's

cooked

too

rare.

Ref 1

not

cooked

enough.

Ref 2

It's

not

cooked

enough.

Ref 3

isn't

done

enough.

Ref 4

It's

too

rare.

Ref 5

This

too

rare.

Output 0

Roasting

into

half

familiar.

N-grams

Roasting	into	half	is	familiar.
			is

Output 1

half

N-grams

half

Output 2

Roasted

rare.

N-grams

Roasted	rare.
	rare.

Output 3

Roasting

into

half

familiar.

N-grams

Roasting	into	half	is	familiar.
			is

Output 4

Roasts

the

half

ripe.

N-grams

Roasts

the

half

ripe.

Sentence 176) BLEU: 0 (0.4167/0.09091/0/0) ; 0 (0.4545/0.1/0/0) ; 0 (0.4444/0.125/0/0) ; 0 (0.4167/0.09091/0/0) ; 0 (0.4545/0.1/0/0)

Source

饻

�H�f

��

�ʤ��

�K

�Q

��

�b

��

�C

Ref 0

Nearly

eighty

percent

the

Japanese

people

live

urban

areas.

Ref 1

Almost

eighty

percent

Japanese

people

live

urban

areas.

Ref 2

Almost

eighty

percent

people

Japan

live

inner-city

areas.

Ref 3

Almost

eighty

percent

all

Japanese

people

are

urban

dwellers.

Ref 4

Nearly

eighty

percent

the

Japanese

live

urban

areas.

Ref 5

Nearly

eighty

percent

the

Japanese

people

live

urban

areas.

Output 0

Japanese

population

80%

live

the

city.

N-grams

Japanese	population	of	be	close	to	80%	to	live	in	the	city.
Japanese		of						live	in	the
								live in

Output 1

population

nearly

percent

live

japanese

the

city

N-grams

population	of	nearly	80	percent	live	in	japanese	the	city	.
	of			percent	live	in		the
					live in

Output 2

Japan's

population

nearly

percent

live

cities.

N-grams

Japan's	population	of	nearly	80	percent	live	in	cities.
		of			percent	live	in
						live in

Output 3

Japanese

population

80%

live

the

city.

N-grams

Japanese	population	of	be	close	to	80%	to	live	in	the	city.
Japanese		of						live	in	the
								live in

Output 4

The

Japanese

population

nearly

percent

eight

ten

live

the

city.

N-grams

The	Japanese	population	nearly	percent	eight	ten	live	in	the	city.
	Japanese			percent			live	in	the
							live in

Sentence 177) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0/0/0/0)

Source

��

§�~

�ө�

��

�H

Ref 0

there

souvenir

shop?

Ref 1

there

shop

for

souvenirs?

Ref 2

there

gift

shop?

Ref 3

there

place

buy

souvenirs?

Ref 4

there

souvenir

shop?

Ref 5

there

shop

that

sells

souvenirs?

Output 0

there

gift

store?

N-grams

Is	there	gift	store?
Is	there	gift
Is there

Output 1

gift

store

N-grams

gift	store	?
gift

Output 2

Have

gift

store?

N-grams

Have	gift	store?
	gift

Output 3

there

gift

store?

N-grams

Is	there	gift	store?
Is	there	gift
Is there

Output 4

Has

the

present

store?

N-grams

Has

the

present

store?

Sentence 178) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.2/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.5/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�ı�

�e

��

�n

��

�H

Ref 0

Can

you

deliver

them

this

evening?

Ref 1

Could

you

deliver

them

this

evening?

Ref 2

Can

have

them

this

evening?

Ref 3

Can

get

them

tonight?

Ref 4

Can

you

get

them

here

this

evening?

Ref 5

Will

you

able

deliver

them

this

evening?

Output 0

Before

you

this

evening?

N-grams

Before	you	this	evening?
	you	this	evening?
		this evening?

Output 1

before

this

evening

can

N-grams

before	this	evening	can	?
	this

Output 2

Before

you

this

evening?

N-grams

Before	you	this	evening?
	you	this	evening?
		this evening?

Output 3

Can

good

before

today

evening?

N-grams

Can	be	good	before	today	evening?
Can	be				evening?

Output 4

Before

this

evening,

can?

N-grams

Before	this	evening,	can?
	this

Sentence 179) BLEU: 0 (0.375/0.1429/0/0) ; 0 (0.4/0.2222/0/0) ; 0 (0.375/0.1429/0/0) ; 0 (0.3/0.1111/0/0) ; 0 (0.375/0.1429/0/0)

Source

�z

��

�c��

�O

��

�@

�a

�H

Ref 0

Can

you

recommend

shoe

store?

Ref 1

Could

you

recommend

shoe

store?

Ref 2

Can

you

advise

shoe

shop?

Ref 3

there

shoe

store

that

you

would

suggest?

Ref 4

Can

you

suggest

shoe

store?

Ref 5

Could

you

recommend

store

for

shoes?

Output 0

You

recommend

which

one

the

shoe

store?

N-grams

You	recommend	which	one	of	the	shoe	store?
	recommend					shoe	store?
						shoe store?

Output 1

you

recommend

which

one

the

shoe

store

N-grams

you	recommend	which	one	of	the	shoe	store	is	?
you	recommend					shoe	store
you recommend						shoe store

Output 2

You

recommend

which

one

the

shoe

store?

N-grams

You	recommend	which	one	of	the	shoe	store?
	recommend					shoe	store?
						shoe store?

Output 3

You

recommend

which

house

the

shoe

store

N-grams

You	recommend	of	which	house	is	the	shoe	store	?
	recommend						shoe	store
							shoe store

Output 4

You

recommend

which

one

the

shoe

store?

N-grams

You	recommend	which	one	is	the	shoe	store?
	recommend					shoe	store?
						shoe store?

Sentence 180) BLEU: 0 (0.3333/0.125/0/0) ; 0 (0.4444/0/0/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.4/0.1111/0/0) ; 0 (0.5/0.1429/0/0)

Source

��

��F

��

�ɶ�

�O

�h

��

�H

Ref 0

How

long

does

take

reach

Los

Angeles?

Ref 1

How

long

does

take

travel

Los

Angeles?

Ref 2

How

much

time

does

take

get

Los

Angeles?

Ref 3

How

many

hours

does

take

get

Los

Angeles?

Ref 4

How

long

does

take

get

Los

Angeles?

Ref 5

How

much

time

does

take

reach

get

Los

Angeles?

Output 0

Time

flight

Los

Angeles

are

many

long?

N-grams

Time	of	flight	to	Los	Angeles	are	many	long?
			to	Los			many
			to Los

Output 1

time

flight

los

angeles

long

much

N-grams

time	flight	to	los	angeles	long	is	much	?
time		to			long		much

Output 2

Time

flight

Los

Angeles

are

many

long?

N-grams

Time	of	flight	to	Los	Angeles	are	many	long?
			to	Los			many
			to Los

Output 3

flight

time

that

gets

Los

Angeles

much

long?

N-grams

Is	flight	time	that	gets	to	Los	Angeles	much	long?
		time			to	Los		much
					to Los

Output 4

much

long

Los

Angeles's

flight

time?

N-grams

Is	much	long	to	Los	Angeles's	flight	time?
	much	long	to	Los
			to Los

Sentence 181) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.8/0.75/0/0) ; 0 (0.8/0.75/0.3333/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.8/0.75/0.3333/0)

Source

�n

�@

��

�G��

�C

Ref 0

Don't

make

any

excuses.

Ref 1

not

make

excuses.

Ref 2

not

want

hear

excuses.

Ref 3

Stop

making

excuses.

Ref 4

Don't

make

any

excuses.

Ref 5

excuses,

please.

Output 0

Don't

make

any

defense.

N-grams

Don't	make	any	defense.
Don't	make	any
Don't make
Don't make any
	make any

Output 1

not

make

any

N-grams

do	not	make	any	.
do	not	make	any
do not		make any
	not make

Output 2

not

make

any

excuse.

N-grams

Do	not	make	any	excuse.
Do	not	make	any
Do not		make any
Do not make
	not make

Output 3

Don't

make

any

defense.

N-grams

Don't	make	any	defense.
Don't	make	any
Don't make
Don't make any
	make any

Output 4

not

make

any

argument.

N-grams

Do	not	make	any	argument.
Do	not	make	any
Do not		make any
Do not make
	not make

Sentence 182) BLEU: 0.5 (0.875/0.7143/0.5/0.2) ; 0 (0.4444/0.25/0.1429/0) ; 0.5 (0.875/0.7143/0.5/0.2) ; 0 (0.6667/0.2727/0.1/0) ; 0 (0.5455/0.1/0/0)

Source

��

�n

�@

��

�饻

��

�s��

�q��

�C

Ref 0

I'd

make

station-to-station

call

Japan,

please.

Ref 1

want

make

station-to-station

call

Japan,

please.

Ref 2

would

station-to-station

phone

call

Japan.

Ref 3

want

make

call

Japan

station-to-station,

please.

Ref 4

would

make

station-to-station

call

Japan,

please.

Ref 5

I'd

place

station-to-station

call

Japan,

please.

Output 0

would

call

Japan

tel.

N-grams

I	would	like	a	call	to	Japan	tel.
I	would	like	a	call	to	Japan
I would			a call		to Japan
I would like			a call to
	would like		a call to Japan
				call to
				call to Japan

Output 1

call

japan

number

telephone

N-grams

i	a	call	to	japan	to	number	telephone	.
	a	call	to		to
	a call
	a call to
		call to

Output 2

would

call

Japan

Tel.

N-grams

I	would	like	a	call	to	Japan	Tel.
I	would	like	a	call	to	Japan
I would			a call		to Japan
I would like			a call to
	would like		a call to Japan
				call to
				call to Japan

Output 3

want

Japan

call

number

telephone.

N-grams

I	want	to	be	a	to	Japan	of	call	a	number	telephone.
I	want	to		a	to	Japan		call
I want					to Japan
I want to
	want to

Output 4

take

one

call

number

the

telephone

Japan.

N-grams

I	take	one	to	call	a	number	the	telephone	to	Japan.
I			to	call	a				to	Japan.
									to Japan.

Sentence 183) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.3333/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.6667/0.5/0/0)

Source

�h��

��

�H

Ref 0

How

much

the

fare?

Ref 1

How

much

the

fare?

Ref 2

What

the

price

for

ticket?

Ref 3

What

the

fare?

Ref 4

What

the

cost

the

fare?

Ref 5

What

does

the

fare

cost?

Output 0

How

much

it?

N-grams

How	much	is	it?
How	much	is
How much
How much is
	much is

Output 1

how

much

N-grams

how	much	?
	much

Output 2

How

much

it?

N-grams

How	much	is	it?
How	much	is
How much
How much is
	much is

Output 3

How

much

N-grams

How	much	?
How	much
How much

Output 4

How

much

money?

N-grams

How	much	money?
How	much
How much

Sentence 184) BLEU: 0 (0.2857/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.25/0/0/0)

Source

�o��

�a

�o

��[

�F

�C

Ref 0

This

fell

apart.

Ref 1

This

fell

apart.

Ref 2

This

came

apart.

Ref 3

This

fell

apart.

Ref 4

This

fell

pieces.

Ref 5

This

has

fallen

apart.

Output 0

This

bad

and

have

Spread.

N-grams

This	is	bad	and	have	to	Spread.
This					to

Output 1

this

bad

N-grams

this	bad	to	.
		to

Output 2

This

bad

fall

pieces.

N-grams

This	bad	of	a	fall	to	pieces.
This					to	pieces.
					to pieces.

Output 3

This

bad

and

have

spread.

N-grams

This	is	bad	and	have	to	spread.
This					to

Output 4

This

was

bad

disperses.

N-grams

This	was	bad	disperses.
This

Sentence 185) BLEU: 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2308/0/0/0) ; 0 (0.2727/0/0/0)

Source

�o��

�u

��

�{��

��

��f

�I��

�C

Ref 0

only

cash.
Please

exchange

that

window.

Ref 1

only

cash.
Please

exchange

that

window.

Ref 2

only

take

cash.
Please

exchange

your

money

the

cashier.

Ref 3

only

take

cash.
Please

make

your

purchase

that

window.

Ref 4

take

only

cash.
Please

exchange

that

window.

Ref 5

only

cash.
Please

exchange

your

money

that

window.

Output 0

Here

only

the

other

side

the

window

cash

convertible.

N-grams

Here	only	go	to	the	other	side	of	the	window	cash	convertible.
	only			the

Output 1

here

only

the

side

window

cash

that

N-grams

here	only	to	the	side	window	cash	that	.
	only		the				that

Output 2

Here

only

the

other

side

the

window

cash

convertible.

N-grams

Here	only	go	to	the	other	side	of	the	window	cash	convertible.
	only			the

Output 3

The

window

way

that

only

accepts

cash

invite

that

direction

here

exchanges.

N-grams

The

window

way

that

only

accepts

cash

invite

that

direction

here

exchanges.

that

only

Output 4

Here

only

collects

the

cash

welcome

that

side

window

exchange.

N-grams

Here	only	collects	the	cash	welcome	to	that	side	window	exchange.
	only		the				that

Sentence 186) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�n

��

��l

�I��

�X��

�F

��\

�F

�I

Ref 0

That's

right,

good

work.

Ref 1

That

correct,

good

work.

Ref 2

That's

okay,

well

done.

Ref 3

That

correct,

good

job.

Ref 4

That's

right,

good

job.

Ref 5

That's

correct,

good

work.

Output 0

would

point

out

the

bosons

success!

N-grams

would

point

out

the

bosons

success!

Output 1

point

out

the

want

came

succeed

N-grams

point

out

the

want

came

succeed

Output 2

would

point

out

the

bosons

success!

N-grams

would

point

out

the

bosons

success!

Output 3

want

the

color

sub-

point

came

out

succeed!

N-grams

want

the

color

sub-

point

came

out

succeed!

Output 4

want

the

dice

points

came

out

succeed!

N-grams

want

the

dice

points

came

out

succeed!

Sentence 187) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.1429/0/0/0)

Source

�w�q

�F

��

�q��

�C

Ref 0

I've

reserved

two

connecting

rooms

for

tonight.

Ref 1

have

reserved

two

connecting

rooms

for

tonight.

Ref 2

have

booked

two

connecting

rooms

for

tonight.

Ref 3

have

reserved

two

connecting

rooms

for

this

evening.

Ref 4

have

reserved

pair

connecting

rooms

for

tonight.

Ref 5

For

tonight,

have

reserved

two

connecting

rooms.

Output 0

Reserved

the

tonight.

N-grams

Reserved	of	the	tonight.
	of		tonight.

Output 1

tonight

N-grams

tonight

Output 2

Booked

tonight

between

Qualcomm.

N-grams

Booked

tonight

between

Qualcomm.

Output 3

Reserved

the

tonight.

N-grams

Reserved	of	the	tonight.
	of		tonight.

Output 4

Has

ordered

tonight's

adjoining

and

intercommunicating

rooms.

N-grams

Has	ordered	tonight's	adjoining	and	intercommunicating	rooms.
						rooms.

Sentence 188) BLEU: 0 (0.4/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0/0/0)

Source

��

�o��

�]

��}

�C

Ref 0

Please

open

this

bag.

Ref 1

Open

this

bag,

please.

Ref 2

Can

you

open

this

bag,

please?

Ref 3

Please

open

this

bag.

Ref 4

Would

you

open

this

bag,

please?

Ref 5

Could

you

open

this

bag,

please?

Output 0

Please

turn

this

package.

N-grams

Please	turn	on	this	package.
Please			this

Output 1

please

open

this

package

N-grams

please	open	this	package	.
	open	this
	open this

Output 2

Please

open

this

package.

N-grams

Please	open	this	package.
Please	open	this
Please open
Please open this
	open this

Output 3

Please

open

this

pack.

N-grams

Please	open	this	pack.
Please	open	this
Please open
Please open this
	open this

Output 4

Please

turn

this

package.

N-grams

Please	turn	on	this	package.
Please			this

Sentence 189) BLEU: 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.375/0.2857/0.1667/0) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.4/0/0/0)

Source

��

�@

�M

�@��

�C

Ref 0

I'd

cup

coffee.

Ref 1

would

cup

coffee.

Ref 2

want

cup

coffee.

Ref 3

would

have

cup

coffee.

Ref 4

I'd

have

cup

coffee.

Ref 5

would

cup

coffee,

please.

Output 0

Please

give

cup

coffee.

N-grams

Please	give	me	a	cup	of	coffee.
			a	cup	of	coffee.
			a cup		of coffee.
			a cup of
			a cup of coffee.
				cup of
				cup of coffee.

Output 1

please

give

cup

coffee

N-grams

please	give	me	a	cup	of	coffee	.
			a	cup	of
			a cup
			a cup of
				cup of

Output 2

Please

give

cup

coffee.

N-grams

Please	give	me	a	cup	of	coffee.
			a	cup	of	coffee.
			a cup		of coffee.
			a cup of
			a cup of coffee.
				cup of
				cup of coffee.

Output 3

Please

give

cup

coffee.

N-grams

Please	give	me	a	cup	of	coffee.
			a	cup	of	coffee.
			a cup		of coffee.
			a cup of
			a cup of coffee.
				cup of
				cup of coffee.

Output 4

Please

give

coffee.

N-grams

Please	give	me	a	coffee.
			a	coffee.

Sentence 190) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0)

Source

�a

�^�h

�C

Ref 0

I'll

take

go.

Ref 1

I'd

go.

Ref 2

will

have

take

away.

Ref 3

would

go.

Ref 4

go,

please.

Ref 5

I'll

have

go.

Output 0

Bring

return

to.

N-grams

Bring	to	return	to.
	to

Output 1

back

N-grams

back

Output 2

Back.

N-grams

Back.

Output 3

Bring

return

to.

N-grams

Bring	to	return	to.
	to

Output 4

Brings

back.

N-grams

Brings

back.

Sentence 191) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6667/0.5/0/0)

Source

��

�զ�

�h

�C

Ref 0

I've

got

earache.

Ref 1

have

earache.

Ref 2

ear

aches.

Ref 3

I've

got

earache.

Ref 4

I've

got

earache.

Ref 5

I've

got

earache.

Output 0

ear

pain.

N-grams

My	ear	pain.
My	ear
My ear

Output 1

ear

pain

N-grams

ear	pain	my	.
ear

Output 2

ear

pain.

N-grams

I	ear	pain.
I	ear

Output 3

The

ear

painful.

N-grams

The	my	ear	is	painful.
		ear

Output 4

ear

pain.

N-grams

My	ear	pain.
My	ear
My ear

Sentence 192) BLEU: 0.3457 (0.5/0.4286/0.3333/0.2) ; 0 (0.5556/0.25/0.1429/0) ; 0.3457 (0.5/0.4286/0.3333/0.2) ; 0.3753 (0.5556/0.5/0.4286/0.1667) ; 0 (0.3333/0.125/0/0)

Source

��

�C�~��]

��

�W��

�C

Ref 0

Can

have

youth

hostel

list?

Ref 1

Could

have

list

youth

hostels?

Ref 2

May

have

the

list

your

youth

hostels?

Ref 3

Could

have

list

the

hostels

for

youths?

Ref 4

Can

have

list

the

youth

hostels?

Ref 5

Can

have

the

list

youth

hostels?

Output 0

Please

give

list

youth

hostels.

N-grams

Please	give	me	a	list	of	youth	hostels.
			a	list	of	youth
			a list		of youth
			a list of
			a list of youth
				list of
				list of youth

Output 1

please

give

list

youth

the

N-grams

please	give	me	list	of	youth	the	the	.
			list	of	youth	the
			list of
			list of youth
				of youth

Output 2

Please

give

list

youth

hostels.

N-grams

Please	give	me	a	list	of	youth	hostels.
			a	list	of	youth
			a list		of youth
			a list of
			a list of youth
				list of
				list of youth

Output 3

Please

give

the

list

the

youth

hostler.

N-grams

Please	give	me	the	list	of	the	youth	hostler.
			the	list	of	the youth
			the list		of the		youth
			the list of
				list of
				list of the
				list of the youth
					of the youth

Output 4

Please

give

the

youth

hotel

the

name

list.

N-grams

Please	give	me	the	youth	hotel	the	name	list.
			the	youth
			the youth

Sentence 193) BLEU: 0 (0.2222/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.1429/0/0/0)

Source

��

�A

�T�{

�@�U

�w�q

�C

Ref 0

I'd

reconfirm

flight.

Ref 1

want

reconfirm

flight.

Ref 2

I'd

reconfirm

flight.

Ref 3

want

confirm

flight.

Ref 4

would

confirm

flight.

Ref 5

would

reconfirm

flight,

please.

Output 0

Please

confirm

again

while

reserve

for

me.

N-grams

Please	confirm	again	to	a	while	reserve	for	me.
	confirm		to

Output 1

please

confirm

again

for

N-grams

please	confirm	again	for	me	.
	confirm

Output 2

Please

re-confirm

booking.

N-grams

Please	re-confirm	my	booking.
		my

Output 3

Please

confirm

again

while

reserve

for

me.

N-grams

Please	confirm	again	to	a	while	reserve	for	me.
	confirm		to

Output 4

Please

for

again

confirm

that

orders.

N-grams

Please	for	me	again	confirm	that	orders.
				confirm

Sentence 194) BLEU: 0 (0.1538/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1818/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1538/0/0/0)

Source

�L

��

�O

�Q�I

�t

�G�Q��

�٬O

�Q�I

�L

�G�Q��

�H

Ref 0

Did

hear

twenty

minutes

before

ten

twenty

after

ten?

Ref 1

Did

hear

twenty

minutes

before

ten

twenty

after

ten?

Ref 2

Was

twenty

ten

twenty

minutes

past

ten?

Ref 3

Was

that

twenty

minutes

ten

twenty

minutes

after

ten?

Ref 4

Was

that

twenty

minutes

before

ten

twenty

after

ten?

Ref 5

Did

hear

twenty

minutes

before

ten

twenty

minutes

after

ten?

Output 0

What

said

ten

difference

points

ten

spot

points?

N-grams

What

said

ten

difference

points

ten

spot

points?

ten

Output 1

said

what

N-grams

said

what

Output 2

said

the

poor

are

10:00

before

10:00

am?

N-grams

He	said	the	poor	are	10:00	am	or	before	10:00	am?
							or	before

Output 3

What

say

differs

10:0020

cent

still

10:00

lead

cent?

N-grams

What

say

differs

10:0020

cent

still

10:00

lead

cent?

Output 4

What

said

ten

difference

points

ten

spot

points?

N-grams

What

said

ten

difference

points

ten

spot

points?

ten

Sentence 195) BLEU: 0 (1/0.75/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (1/0.75/0/0) ; 0 (1/0.75/0/0) ; 0 (1/0.75/0/0)

Source

�o

�O

�ж�

�_��

�C

Ref 0

This

your

room

key.

Ref 1

Here

the

key

your

room.

Ref 2

This

your

room

key.

Ref 3

This

your

room

key.

Ref 4

Here

your

room

key.

Ref 5

Here's

your

room

key.

Output 0

This

the

room

key.

N-grams

This	is	the	room	key.
This	is	the	room	key.
This is			room key.
	is the

Output 1

this

the

room

key

N-grams

this	is	the	room	key	.
	is	the	room	key
	is the

Output 2

This

the

room

key.

N-grams

This	is	the	room	key.
This	is	the	room	key.
This is			room key.
	is the

Output 3

This

the

room

key.

N-grams

This	is	the	room	key.
This	is	the	room	key.
This is			room key.
	is the

Output 4

This

the

room

key.

N-grams

This	is	the	room	key.
This	is	the	room	key.
This is			room key.
	is the

Sentence 196) BLEU: 1 (1/1/1/1) ; 0 (0.5/0.2857/0/0) ; 0.4889 (0.8571/0.6667/0.4/0.25) ; 1 (1/1/1/1) ; 1 (1/1/1/1)

Source

��

�Q

�h

�ª��s

�C

Ref 0

would

San

Francisco.

Ref 1

I'd

travel

San

Francisco.

Ref 2

want

travel

San

Francisco,

please.

Ref 3

want

San

Francisco.

Ref 4

I'd

San

Francisco.

Ref 5

would

travel

San

Francisco.

Output 0

want

San

Francisco.

N-grams

I	want	to	go	to	San	Francisco.
I	want	to	go	to	San	Francisco.
I want		to go		to San
I want to			go to		San Francisco.
I want to go				to San Francisco.
	want to		go to San
	want to go
	want to go to
		to go to
		to go to San
			go to San Francisco.

Output 1

san

francisco

want

N-grams

i	to	go	san	francisco	want	to	.
	to	go			want	to
	to go				want to

Output 2

I'd

San

Francisco.

N-grams

I'd	like	to	go	in	San	Francisco.
I'd	like	to	go		San	Francisco.
I'd like		to go			San Francisco.
I'd like to
I'd like to go
	like to
	like to go

Output 3

want

San

Francisco.

N-grams

I	want	to	go	to	San	Francisco.
I	want	to	go	to	San	Francisco.
I want		to go		to San
I want to			go to		San Francisco.
I want to go				to San Francisco.
	want to		go to San
	want to go
	want to go to
		to go to
		to go to San
			go to San Francisco.

Output 4

want

San

Francisco.

N-grams

I	want	to	go	to	San	Francisco.
I	want	to	go	to	San	Francisco.
I want		to go		to San
I want to			go to		San Francisco.
I want to go				to San Francisco.
	want to		go to San
	want to go
	want to go to
		to go to
		to go to San
			go to San Francisco.

Sentence 197) BLEU: 0 (0.25/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4/0.25/0/0)

Source

�ت�

�O

�Ӱ�

�C

Ref 0

I'm

here

business.

Ref 1

I'm

here

business.

Ref 2

This

business

trip.

Ref 3

business

trip.

Ref 4

here

business.

Ref 5

I'm

here

for

business

reasons.

Output 0

The

purpose

business.

N-grams

The	purpose	of	business.
			business.

Output 1

the

purpose

business

N-grams

the	purpose	business	is	a	.
		business	is	a
			is a

Output 2

The

purpose

business.

N-grams

The	purpose	of	business.
			business.

Output 3

The

purpose

business.

N-grams

The	purpose	is	a	business.
		is	a	business.
		is a

Output 4

The

goal

commerce.

N-grams

The	goal	is	a	commerce.
		is	a
		is a

Sentence 198) BLEU: 0.3514 (0.5556/0.4706/0.4375/0.1333) ; 0 (0.2222/0/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.2222/0/0/0) ; 0.3514 (0.5556/0.4706/0.4375/0.1333)

Source

��

�I��

��

�F��

�s

�T

�E

�C

Ref 0

Collect

call

Tokyo

number

zero

three

triple

nine

quadruple

nine.

Ref 1

collect

call

Tokyo

number

zero

three

triple

nine

quadruple

nine.

Ref 2

Collect

phone

call

Tokyo

number

zero

three

triple

nine

quadruple

nine.

Ref 3

want

make

collect

call

Tokyo.
The

number

zero

three

nine

nine,

nine

nine.

Ref 4

Collect

call

Tokyo

number

zero

three

nine

nine,

nine

nine.

Ref 5

Collect

call

Tokyo,

the

number

zero,

three,

nine

nine,

nine

nine.

Output 0

Pays

money

opposite

party

please

meet

Tokyo

zero

three

nine

nine.

N-grams

Pays

money

opposite

party

please

meet

Tokyo

zero

three

nine

nine.

Tokyo

zero

three

nine

nine nine.

zero three

nine nine

nine nine nine.

zero three nine

nine nine

nine nine nine nine.

zero three nine nine

nine.

three nine

three nine nine

nine nine nine

Output 1

please

payment

the

other

zero

tokyo

39999999

party

N-grams

please	payment	the	other	zero	tokyo	39999999	party	.
		the		zero

Output 2

Please

take

payment

from

the

other

side

zero

Tokyo

39999999.

N-grams

Please	take	payment	from	the	other	side	of	zero	Tokyo	39999999.
				the				zero	Tokyo

Output 3

The

other

party

payment

asks

connect

Tokyo

zero

39999999.

N-grams

The	other	party	payment	asks	connect	Tokyo	zero	39999999.
						Tokyo	zero

Output 4

Pays

money

opposite

party

please

meet

Tokyo

zero

three

nine

nine.

N-grams

Pays

money

opposite

party

please

meet

Tokyo

zero

three

nine

nine.

Tokyo

zero

three

nine

nine nine.

zero three

nine nine

nine nine nine.

zero three nine

nine nine

nine nine nine nine.

zero three nine nine

nine.

three nine

three nine nine

nine nine nine

Sentence 199) BLEU: 0 (0.2/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�H

��

�y��

��

�H

Ref 0

you

have

table

for

two?

Ref 1

there

table

for

two

available?

Ref 2

Have

you

got

table

for

two?

Ref 3

there

table

for

two?

Ref 4

Would

you

have

table

for

two

available?

Ref 5

table

for

two

available?

Output 0

Two

people

have

the

seat?

N-grams

Two	people	have	the	seat?
		have

Output 1

two

people

have

seat

N-grams

two	people	have	seat	?
two		have

Output 2

Two

people

have

seat?

N-grams

Two	people	have	seat?
		have

Output 3

two

people

have

seat?

N-grams

Do	two	people	have	seat?
Do	two		have

Output 4

Two

people

have

the

seat?

N-grams

Two	people	have	the	seat?
		have

Sentence 200) BLEU: 0 (1/1/0/0) ; 0 (0.4/0/0/0) ; 0 (1/1/0/0) ; 0 (0.5/0/0/0) ; 0 (0.8/0/0/0)

Source

�䥦

��

�C��

��

�H

Ref 0

What

other

colors

you

have?

Ref 1

What

additional

colors

you

have?

Ref 2

What

other

tints

have

you

got?

Ref 3

you

have

any

other

colors?

Ref 4

you

have

other

colors?

Ref 5

What

other

colors

you

have?

Output 0

What

other

colors?

N-grams

What	other	colors?
What	other	colors?
What other
	other colors?

Output 1

what

other

color

have

N-grams

what	other	color	have	?
	other		have

Output 2

What

other

colors?

N-grams

What	other	colors?
What	other	colors?
What other
	other colors?

Output 3

What

color

does

the

other

have?

N-grams

What	color	does	the	other	have?
What				other	have?

Output 4

What

color

other

have?

N-grams

What	color	do	other	have?
What		do	other	have?

Sentence 201) BLEU: 0 (0.2857/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.375/0.1429/0/0) ; 0.3928 (0.625/0.5714/0.3333/0.2)

Source

�o��

�Ȧ�

�j��

�n

�h��

�ɶ�

�H

Ref 0

How

long

does

take

complete

this

tour?

Ref 1

How

long

does

take

complete

this

tour?

Ref 2

How

much

time

does

take

round

this

route?

Ref 3

How

long

this

tour?

Ref 4

How

long

does

this

tour

take?

Ref 5

How

long

does

this

tour

last?

Output 0

The

amount

time

travel

around?

N-grams

The	amount	of	time	to	travel	around?
			time	to

Output 1

time

travel

how

does

this

want

N-grams

time	travel	how	does	this	want	?
time			does	this
			does this

Output 2

The

amount

time

travel

around?

N-grams

The	amount	of	time	to	travel	around?
			time	to

Output 3

How

many

times

does

this

trip

about

want?

N-grams

How	many	times	does	this	trip	about	want?
How			does	this
			does this

Output 4

How

much

time

does

this

travel

probably

want?

N-grams

How	much	time	does	this	travel	probably	want?
How	much	time	does	this
How much		time does
How much time			does this
How much time does
	much time
	much time does

Sentence 202) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.4/0.25/0/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5/0.2/0/0) ; 0 (0/0/0/0)

Source

�i�H

��

�H

Ref 0

Can't

you

give

discount?

Ref 1

Couldn't

you

give

discount?

Ref 2

How

about

giving

discount?

Ref 3

Can

get

discount?

Ref 4

Isn't

there

discount?

Ref 5

Could

you

not

give

discount?

Output 0

You

can

give

discount?

N-grams

You	can	give	me	a	discount?
		give	me	a	discount?
		give me		a discount?
		give me a
		give me a discount?
			me a
			me a discount?

Output 1

discount

may

N-grams

me	a	discount	may	?
me	a
me a

Output 2

You

can

give

discount?

N-grams

You	can	give	me	a	discount?
		give	me	a	discount?
		give me		a discount?
		give me a
		give me a discount?
			me a
			me a discount?

Output 3

May

sell

discount?

N-grams

May	I	sell	at	a	discount?
	I			a	discount?
				a discount?

Output 4

May

discount

me?

N-grams

May

discount

me?

Sentence 203) BLEU: 0 (0.4/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.1667/0/0/0)

Source

�k�L

�o��

�C

Ref 0

right

foot

numb.

Ref 1

have

loss

all

feeling

right

foot.

Ref 2

right

foot

deadened.

Ref 3

have

feeling

right

foot.

Ref 4

right

foot

numb.

Ref 5

right

foot

feels

numb.

Output 0

The

right

leg

becomes

numb.

N-grams

The	right	leg	becomes	numb.
	right			numb.

Output 1

right

leg

numb

the

N-grams

right	leg	numb	the	.
right

Output 2

Right

leg

was

numb.

N-grams

Right	leg	was	numb.
			numb.

Output 3

The

right

leg

becomes

numb.

N-grams

The	right	leg	becomes	numb.
	right			numb.

Output 4

The

right

leg

tingles

with

numbness.

N-grams

The	right	leg	tingles	with	numbness.
	right

Sentence 204) BLEU: 0 (0.375/0.1429/0/0) ; 0 (0.2/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.375/0.1429/0/0)

Source

�ƺ��y��

�O

��

�X

��

�H

Ref 0

How

many

stops

the

Hilton?

Ref 1

How

many

stops

the

Hilton?

Ref 2

How

many

stops

are

there

before

reaching

the

Hilton?

Ref 3

How

many

stops

are

there

between

here

and

the

Hilton?

Ref 4

How

many

stops

until

the

Hilton?

Ref 5

How

many

stops

before

the

Hilton?

Output 0

How

many

stations

the

Hilton

Hotel

the?

N-grams

How	many	stations	is	the	Hilton	Hotel	the?
How	many			the
How many

Output 1

hilton

hotel

the

N-grams

hilton	hotel	is	the	?
			the

Output 2

Hilton

Hotel

the

first

several

stops?

N-grams

Hilton	Hotel	is	the	first	of	several	stops?
			the

Output 3

Hilton

hotel

which

stand?

N-grams

Is	Hilton	hotel	to	which	stand?
			to

Output 4

How

many

stations

the

Hilton

Hotel

the?

N-grams

How	many	stations	is	the	Hilton	Hotel	the?
How	many			the
How many

Sentence 205) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.4286/0.3333/0.2/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.2/0/0/0)

Source

�\��

�b

��

�a��

�H

Ref 0

Where

the

dining

car?

Ref 1

Where

the

restaurant

car?

Ref 2

Where

the

restaurant

carriage?

Ref 3

Where

can

find

the

dining

car?

Ref 4

Where's

the

dining

car

located?

Ref 5

Where

the

dining

car

located?

Output 0

What

place

the

dining

car?

N-grams

What	place	in	the	dining	car?
			the	dining	car?
			the dining
			the dining car?
				dining car?

Output 1

what

place

the

dining

car

N-grams

what	place	in	the	dining	car	?
			the	dining	car
			the dining
			the dining car
				dining car

Output 2

What

place

the

dining

car?

N-grams

What	place	in	the	dining	car?
			the	dining	car?
			the dining
			the dining car?
				dining car?

Output 3

Where

the

serving

cart

N-grams

Where	is	the	serving	cart	?
Where	is	the
Where is
Where is the
	is the

Output 4

Dining

car

what

place?

N-grams

Dining	car	in	what	place?
	car

Sentence 206) BLEU: 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�H

�۩I

�z

�F

��

�H

Ref 0

Are

you

being

taken

care

of?

Ref 1

Are

you

being

taken

care

of?

Ref 2

Are

you

being

served?

Ref 3

someone

helping

you?

Ref 4

Are

you

being

helped?

Ref 5

Are

you

being

taken

care

of?

Output 0

Some

people

call

you?

N-grams

Some	people	call	you?
			you?

Output 1

some

people

you

N-grams

some	people	you	?
		you

Output 2

Some

people

call

you?

N-grams

Some	people	call	you?
			you?

Output 3

Did

someone

receive

you?

N-grams

Did	someone	receive	you?
	someone		you?

Output 4

Some

people

have

greeted

you?

N-grams

Some	people	have	greeted	you?
				you?

Sentence 207) BLEU: 0.6804 (0.8571/0.8333/0.6/0.5) ; 0 (0.5714/0.1667/0/0) ; 0.6804 (0.8571/0.8333/0.6/0.5) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.5/0.4/0.25/0)

Source

�z

�Ʊ�

��

�⦬

�H

Ref 0

How

you

want

receive

it?

Ref 1

How

you

want

get

it?

Ref 2

How

would

you

have

delivered?

Ref 3

How

would

you

receive

it?

Ref 4

How

you

want

receive

it?

Ref 5

How

you

want

receive

it?

Output 0

How

would

you

get

close?

N-grams

How	would	you	like	to	get	close?
How	would	you	like	to	get
How would		you like		to get
How would you			like to
How would you like
	would you
	would you like
	would you like to
		you like to

Output 1

how

you

get

hope

N-grams

how	you	to	get	do	hope	?
	you	to	get	do
		to get

Output 2

How

would

you

get

close?

N-grams

How	would	you	like	to	get	close?
How	would	you	like	to	get
How would		you like		to get
How would you			like to
How would you like
	would you
	would you like
	would you like to
		you like to

Output 3

How

you

hope

get

accept?

N-grams

How	do	you	hope	to	get	to	accept?
How	do	you		to	get
How do				to get
How do you
	do you

Output 4

How

you

hope

the

receipt?

N-grams

How	do	you	hope	the	receipt?
How	do	you
How do
How do you
	do you

Sentence 208) BLEU: 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�E�

��

�a

�C

Ref 0

See

you

the

meeting.

Ref 1

See

you

the

meeting.

Ref 2

See

you

the

meeting.

Ref 3

I'll

see

you

the

meeting.

Ref 4

will

see

you

the

meeting.

Ref 5

See

you

the

meeting.

Output 0

Gathering

see

it.

N-grams

Gathering	see	it.
	see

Output 1

see

N-grams

see	.
see

Output 2

Gathering

see

it.

N-grams

Gathering	see	it.
	see

Output 3

Party

see.

N-grams

Party

see.

Output 4

When

meeting

sees.

N-grams

When

meeting

sees.

Sentence 209) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0.6/0.25/0) ; 1 (1/1/1/1) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.3333/0/0/0)

Source

�O�Ҫ�

�O

�h��

�H

Ref 0

How

much

the

deposit?

Ref 1

What

the

amount

the

deposit?

Ref 2

What's

the

down

payment?

Ref 3

How

much

you

need

for

the

deposit?

Ref 4

What

the

deposit?

Ref 5

What

does

the

deposit

cost?

Output 0

How

much

the

deposit?

N-grams

How	much	is	the	deposit?
How	much	is	the	deposit?
How much		is the
How much is			the deposit?
How much is the
	much is
	much is the
	much is the deposit?
		is the deposit?

Output 1

how

much

the

deposit

N-grams

how	much	is	the	deposit	?
	much	is	the	deposit
	much is		the deposit
	much is the
		is the

Output 2

How

much

the

deposit?

N-grams

How	much	is	the	deposit?
How	much	is	the	deposit?
How much		is the
How much is			the deposit?
How much is the
	much is
	much is the
	much is the deposit?
		is the deposit?

Output 3

How

much

the

security

deposit

N-grams

How	much	is	the	security	deposit	?
How	much	is	the		deposit
How much		is the
How much is
How much is the
	much is
	much is the

Output 4

How

many

are

the

earnest

money?

N-grams

How	many	are	the	earnest	money?
How			the

Sentence 210) BLEU: 0 (0.625/0.2857/0/0) ; 0 (0.5556/0/0/0) ; 0 (0.6667/0.25/0.1429/0) ; 0 (0.625/0.2857/0/0) ; 0 (0.6/0.2222/0/0)

Source

��

�ժ�

��

��O

��w

��

�C

Ref 0

I'm

not

good

sports,

but

watch

them.

Ref 1

not

good

sports,

but

watching

them.

Ref 2

rather

poor

sports,

but

watching

them.

Ref 3

don't

play

sports

well,

but

enjoy

watching

them.

Ref 4

I'm

not

good

playing

sports,

but

watch

them.

Ref 5

I'm

not

good

sports,

but

enjoy

watching

them.

Output 0

don't

excel

athletics

but

see.

N-grams

I	don't	excel	athletics	but	like	to	see.
I	don't			but	like	to
I don't					like to

Output 1

sports

but

not

likes

excel

N-grams

at	sports	but	i	do	not	likes	excel	.
at	sports	but		do	not

Output 2

Good

sports

but

not

look

likes.

N-grams

Good	at	sports	but	I	do	not	look	likes.
	at	sports	but	I	do	not
			but I
			but I do
				I do

Output 3

don't

excel

athletics

but

see.

N-grams

I	don't	excel	athletics	but	like	to	see.
I	don't			but	like	to
I don't					like to

Output 4

not

excel

the

sports,

but

likes

looking.

N-grams

I	do	not	excel	at	the	sports,	but	likes	looking.
I	do	not		at		sports,	but
I do						sports, but

Sentence 211) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.8/0.5/0.3333/0) ; 0.3656 (0.625/0.4286/0.3333/0.2)

Source

��

�ɹC

��

�C

Ref 0

Please

wait

till

the

guide

comes.

Ref 1

Please

wait

until

the

guide

arrives.

Ref 2

Please

wait

till

your

escort

arrives.

Ref 3

Please

wait

for

the

guide.

Ref 4

Please

wait

till

the

guide

comes.

Ref 5

Please

wait

till

the

guide

comes.

Output 0

Please

wait

for

guide.

N-grams

Please	wait	for	a	guide.
Please	wait	for		guide.
Please wait
Please wait for
	wait for

Output 1

please

wait

for

tour

guide

N-grams

please	wait	for	tour	to	guide	.
	wait	for			guide
	wait for

Output 2

Please

wait

for

tour

guides

to.

N-grams

Please	wait	for	tour	guides	to.
Please	wait	for
Please wait
Please wait for
	wait for

Output 3

Please

wait

for

guide.

N-grams

Please	wait	for	a	guide.
Please	wait	for		guide.
Please wait
Please wait for
	wait for

Output 4

Please

wait

for

the

tour

guide

come.

N-grams

Please	wait	for	the	tour	guide	to	come.
Please	wait	for	the		guide
Please wait		for the
Please wait for
Please wait for the
	wait for
	wait for the

Sentence 212) BLEU: 0 (0.4286/0.1667/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.4/0.1111/0/0) ; 0 (0.4286/0/0/0)

Source

��

�ֽ�

��

�n

�H

Ref 0

What

kind

products

are

good

for

dry

skin.

Ref 1

Which

products

are

good

for

dry

skin?

Ref 2

What

type

creams

good

for

dry

skin?

Ref 3

What

would

you

suggest

treat

dry

skin?

Ref 4

What

type

products

are

good

for

dry

skin?

Ref 5

What

kind

products

you

recommend

for

dry

skin?

Output 0

Skin

with

what

kind

good?

N-grams

Skin	do	with	what	kind	of	good?
	do			kind	of
				kind of

Output 1

skin

what

kind

good

the

N-grams

skin	what	kind	of	good	the	?
		kind	of	good
		kind of

Output 2

Skin

with

what

kind

good?

N-grams

Skin	do	with	what	kind	of	good?
	do			kind	of
				kind of

Output 3

The

dry

sex

skin

used

what

kind

good?

N-grams

The	dry	sex	skin	is	used	what	kind	of	good?
	dry			is			kind	of
							kind of

Output 4

What

good

does

the

skin

use?

N-grams

What	good	does	the	skin	to	use?
What	good				to

Sentence 213) BLEU: 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�藍�_

�C

Ref 0

Oh,

I'm

sorry

about

that.

Ref 1

Oh,

apologize

for

that.

Ref 2

Oh,

regret

that

happened.

Ref 3

Oh,

sorry

about

what

happened.

Ref 4

Oh,

sorry

about

that.

Ref 5

Oh,

please

apologies..

Output 0

Sorry.

N-grams

Sorry.

Output 1

sorry

N-grams

sorry	.
sorry

Output 2

beg

your

pardon.

N-grams

Ah	I	beg	your	pardon.
	I

Output 3

Sorry.

N-grams

Sorry.

Output 4

Sorry.

N-grams

Sorry.

Sentence 214) BLEU: 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�M�n

�a

�C

Ref 0

Let's

shake

hands

and

friends

again.

Ref 1

Let's

shake

hands

and

friends

again.

Ref 2

Let's

shake

and

friends

again.

Ref 3

Let's

shake

hands

and

make

up.

Ref 4

Let's

shake

and

friends

again.

Ref 5

Can't

just

shake

hands

and

friends

again?

Output 0

and

all

right.

N-grams

We	and	all	right.
	and

Output 1

N-grams

we	.
we

Output 2

and

all

right.

N-grams

We	and	all	right.
	and

Output 3

are

friendly.

N-grams

are

friendly.

Output 4

become

reconciled.

N-grams

become

reconciled.

Sentence 215) BLEU: 0 (0.1429/0/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.3529/0.0625/0/0) ; 0 (0.3077/0.08333/0/0)

Source

�z

��

�C

�]��

��

�O

��

¾�d

��

�C

Ref 0

It's

pleasure.
After

all,

that's

what

I'm

here

for.

Ref 1

pleasure.
After

all,

that

what

here

for.

Ref 2

pleasure.
After

all,

it's

job.

Ref 3

happy

it.
After

all,

that's

why

I'm

here.

Ref 4

It's

pleasure.
That's

what

I'm

here

for

anyway.

Ref 5

It's

pleasure.
After

all,

that's

why

I'm

here.

Output 0

You

ahead

and

ask.

any

case

because

duty

Ah.

N-grams

You

ahead

and

ask.

any

case

because

duty

Ah.

Output 1

you

ask

because

matter

how

that

N-grams

you	ask	because	it	is	my	no	matter	how	that	.
				is	my				that

Output 2

You

ahead

and

ask.

any

case

because

duty

ah.

N-grams

You

ahead

and

ask.

any

case

because

duty

ah.

Output 3

You

ask

though

ask.

Because

matter

how

say

that

job.

N-grams

You

ask

though

ask.

Because

matter

how

say

that

job.

that

job.

my job.

Output 4

Please

freely

ask.

How

matter

because

saying

that

responsibility.

N-grams

Please

freely

ask.

How

matter

because

saying

that

responsibility.

that

that is

Sentence 216) BLEU: 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2/0/0/0)

Source

�i�H

�ЫK

�C

Ref 0

Yes,

here

you

are.

Ref 1

Yes,

here

you

are.

Ref 2

Yes,

there

you

go.

Ref 3

course,

there

you

go.

Ref 4

Yes,

here

you

are.

Ref 5

Yes,

here

you

go.

Output 0

Can

ahead.

N-grams

Can

ahead.

Output 1

can

you

N-grams

can	do	as	you	.
			you

Output 2

Can

ahead.

N-grams

Can

ahead.

Output 3

Can

you

like.

N-grams

Can	do	as	you	like.
			you

Output 4

May

you

please.

N-grams

May	do	as	you	please.
			you

Sentence 217) BLEU: 0 (0.1818/0/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.375/0.1429/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1818/0/0/0)

Source

��

�w��

��

�n

��

�ж�

�C

Ref 0

I'd

room

with

nice

view.

Ref 1

would

prefer

room

with

nice

view.

Ref 2

would

quarters

with

panoramic

view.

Ref 3

would

have

room

with

good

view.

Ref 4

would

room

with

nice

view.

Ref 5

I'd

room

with

pleasant

view.

Output 0

Please

give

arrange

the

field

vision

good

room.

N-grams

Please	give	me	to	arrange	the	field	of	vision	good	room.
			to						good

Output 1

please

give

good

room

arrangement

vision

the

field

N-grams

please	give	me	good	room	arrangement	vision	the	field	to	.
			good	room					to

Output 2

Please

give

good

room

arrangement

vision.

N-grams

Please	give	me	a	good	room	arrangement	vision.
			a	good	room
			a good

Output 3

Please

the

arrangement

visual

field

good

room

me.

N-grams

Please	the	arrangement	visual	field	good	room	to	me.
					good	room	to

Output 4

Please

give

arrange

the

field

vision

good

room.

N-grams

Please	give	me	to	arrange	the	field	of	vision	good	room.
			to						good

Sentence 218) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0)

Source

�C

Ref 0

have

toothache.

Ref 1

have

toothache.

Ref 2

tooth

aches.

Ref 3

tooth

hurts.

Ref 4

tooth

aches.

Ref 5

I've

got

toothache.

Output 0

Get

toothache.

N-grams

Get	a	toothache.
	a	toothache.
	a toothache.

Output 1

toothache

N-grams

toothache

Output 2

Toothache.

N-grams

Toothache.

Output 3

Get

toothache.

N-grams

Get	a	toothache.
	a	toothache.
	a toothache.

Output 4

Toothache.

N-grams

Toothache.

Sentence 219) BLEU: 0 (0.3333/0.2/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0.2/0/0)

Source

�n��

��

�a��

�d��

�F

�C

Ref 0

afraid

there

mistake.

Ref 1

believe

that

there

mistake.

Ref 2

think

there's

error.

Ref 3

I'm

afraid

that

there's

error.

Ref 4

I'm

afraid

there's

been

mistake.

Ref 5

afraid

there

has

been

mistake.

Output 0

Probably

any

place

made

mistake.

N-grams

Probably	any	place	made	a	mistake.
				a	mistake.
				a mistake.

Output 1

wrong

place

N-grams

wrong

place

Output 2

What

seems

wrong

place.

N-grams

What

seems

wrong

place.

Output 3

Seem

where

make

wrong.

N-grams

Seem

where

make

wrong.

Output 4

Probably

any

place

made

mistake.

N-grams

Probably	any	place	made	a	mistake.
				a	mistake.
				a mistake.

Sentence 220) BLEU: 0 (0.2/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0)

Source

�O

��{

�O��

��

�H

Ref 0

One-way

fare?

Ref 1

one-way

fare?

Ref 2

One-way

ticket?

Ref 3

One-way

ticket?

Ref 4

One-way

fare?

Ref 5

that

one-way

fare?

Output 0

one

way

expenses?

N-grams

Is	an	one	way	expenses?
Is

Output 1

one-way

N-grams

one-way	is	?
one-way

Output 2

Are

one-way

fee?

N-grams

Are	one-way	fee?
	one-way

Output 3

one

way

expenses?

N-grams

Is	an	one	way	expenses?
Is

Output 4

the

one-way

expense?

N-grams

Is	the	one-way	expense?
Is		one-way

Sentence 221) BLEU: 0 (0.1667/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.1667/0/0/0)

Source

��

��@

�Z��

��

�H

Ref 0

there

public

restroom

around

here?

Ref 1

there

public

restroom

near

here?

Ref 2

there

public

toilet

around

here?

Ref 3

there

public

toilet

nearby?

Ref 4

there

public

restroom

nearby?

Ref 5

there

public

bathroom

nearby?

Output 0

The

nearby

has

the

public

toilet?

N-grams

The	nearby	has	the	public	toilet?
				public

Output 1

public

toilet

N-grams

public	toilet	?
public	toilet
public toilet

Output 2

Have

public

toilet

near

you?

N-grams

Have	public	toilet	near	you?
	public	toilet	near
	public toilet

Output 3

There

public

toilet

neighborhood?

N-grams

There	is	public	toilet	in	neighborhood?
		public	toilet
		public toilet

Output 4

The

nearby

has

the

public

toilet?

N-grams

The	nearby	has	the	public	toilet?
				public

Sentence 222) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6/0.25/0/0)

Source

�Q

�R

�f��

�C

Ref 0

I'd

buy

lipstick.

Ref 1

would

buy

lipstick.

Ref 2

I'd

buy

lipstick.

Ref 3

would

purchase

some

lipstick.

Ref 4

would

buy

some

lipstick.

Ref 5

I'd

buy

lipstick.

Output 0

Want

buy

lipstick.

N-grams

Want	to	buy	lipstick.
	to	buy	lipstick.
	to buy

Output 1

want

buy

lipstick

N-grams

want	to	buy	lipstick	.
	to	buy
	to buy

Output 2

Want

buy

lipstick.

N-grams

Want	to	buy	lipstick.
	to	buy	lipstick.
	to buy

Output 3

Want

buy

lipstick.

N-grams

Want	to	buy	lipstick.
	to	buy	lipstick.
	to buy

Output 4

Wants

buy

the

lipstick.

N-grams

Wants	to	buy	the	lipstick.
	to	buy		lipstick.
	to buy

Sentence 223) BLEU: 0 (0.4286/0.3333/0.2/0) ; 0 (0.75/0.6667/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0.4286/0.3333/0.2/0)

Source

�n��

�ɶ�

�O

�X�I

�H

Ref 0

Could

you

tell

the

boarding

time,

please?

Ref 1

Could

you

tell

what

the

boarding

time

is,

please?

Ref 2

Could

you

tell

we'll

allowed

aboard,

please?

Ref 3

What

the

boarding

time,

please?

Ref 4

What's

the

boarding

time,

please?

Ref 5

What

time

boarding

time,

please?

Output 0

How

many

spots

the

boarding

time?

N-grams

How	many	spots	is	the	boarding	time?
			is	the	boarding
			is the
			is the boarding
				the boarding

Output 1

boarding

time

N-grams

boarding	time	is	?
boarding	time	is
boarding time
	time is

Output 2

Boarding

time

few?

N-grams

Boarding	time	is	a	few?
	time	is
	time is

Output 3

What

time

boarding

N-grams

What	time	is	time	of	boarding	?
What	time	is			boarding
What time
What time is
	time is

Output 4

How

many

spots

the

boarding

time?

N-grams

How	many	spots	is	the	boarding	time?
			is	the	boarding
			is the
			is the boarding
				the boarding

Sentence 224) BLEU: 0 (0.6/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

ĵ��

�C

Ref 0

Please

call

the

police.

Ref 1

Call

the

police,

please.

Ref 2

Can

you

call

the

police,

please?

Ref 3

Please

call

the

police.

Ref 4

Please

call

the

police.

Ref 5

Please

call

the

police.

Output 0

Please

look

for

the

police.

N-grams

Please	look	for	the	police.
Please			the	police.
			the police.

Output 1

please

look

for

police

N-grams

please

look

for

police

Output 2

Please

look

for

the

police.

N-grams

Please	look	for	the	police.
Please			the	police.
			the police.

Output 3

Please

find

police.

N-grams

Please	find	a	police.
Please			police.

Output 4

Please

look

for

police.

N-grams

Please	look	for	police.
Please			police.

Sentence 225) BLEU: 0 (0.2/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.5/0/0/0)

Source

�n

�a

��

�n

�O

�H

Ref 0

What

should

bring

the

hospital?

Ref 1

What

should

take

with

the

hospital?

Ref 2

What

should

take

the

hospital?

Ref 3

What

items

should

take

the

hospital?

Ref 4

What

need

bring

the

hospital?

Ref 5

What

need

take

with

the

hospital?

Output 0

take

what

good?

N-grams

To	take	what	is	good?
	take

Output 1

what

good

bring

N-grams

to	what	good	bring	?
to			bring

Output 2

take

what

good?

N-grams

To	take	what	is	good?
	take

Output 3

Want

bring

what

good?

N-grams

Want	to	bring	what	good?
	to	bring
	to bring

Output 4

What

can

bring

well?

N-grams

What	can	bring	well?
What		bring

Sentence 226) BLEU: 0 (0.375/0.1333/0.07143/0) ; 0 (0.3125/0.06667/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.375/0.1333/0.07143/0) ; 0 (0.4/0.1429/0.07692/0)

Source

�Q��

�o�N

�{�b

�n

�h

�F

�C

��

�o

��

�n

�ҥH

��

��_

�F

�C

Ref 0

feel

much

better

now.
I've

been

resting

and

appetite

coming

back.

Ref 1

feel

much

improved

now.
I

have

been

resting

and

appetite

coming

back.

Ref 2

I'm

feeling

much

better

now.
I've

been

taking

easy

and

appetite

coming

back.

Ref 3

feel

lot

better

now.
I've

been

sleeping

and

I'm

getting

appetite

back.

Ref 4

feel

much

better

now.
I

have

been

resting

and

appetite

returning.

Ref 5

feel

lot

better

now.
I've

been

resting

and

I'm

getting

appetite

back.

Output 0

Got

fever

yesterday

much

better

now.

Take

rest

very

well

the

appetite

recovered.

N-grams

Got

fever

yesterday

much

better

now.

Take

rest

very

well

the

appetite

recovered.

much

better

now.

appetite

much better

much better now.

better now.

Output 1

yesterday

fever

now

much

better

rest

well

appetite

restored

very

the

N-grams

yesterday

fever

now

much

better

rest

well

appetite

restored

very

the

much

better

appetite

much better

Output 2

Yesterday,

fever

now

much

better.

rest

well

appetite

restored.

N-grams

Yesterday,	a	fever	is	now	much	better.	So	rest	well	appetite	restored.
	a		is		much					appetite

Output 3

Got

fever

yesterday

much

better

now.

Take

rest

very

well

the

appetite

recovered.

N-grams

Got

fever

yesterday

much

better

now.

Take

rest

very

well

the

appetite

recovered.

much

better

now.

appetite

much better

much better now.

better now.

Output 4

Yesterday

had

fever

much

better

now.

Rests

very

well,

therefore

the

appetite

restored.

N-grams

Yesterday

had

fever

much

better

now.

Rests

very

well,

therefore

the

appetite

restored.

much

better

now.

appetite

much better

much better now.

better now.

Sentence 227) BLEU: 0 (0.1538/0.08333/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1538/0.08333/0/0) ; 0 (0.1429/0/0/0)

Source

�ӻX

�z

��

�ؼ�

�D�`

�a��

�C

Ref 0

Thank

you

for

your

compliment.

Ref 1

Thanks

for

your

compliment.

Ref 2

Thank

you

for

your

compliment.

Ref 3

Thanks

you

for

your

kind

words.

Ref 4

Thanks

for

the

compliment.

Ref 5

Thank

you

for

the

compliment.

Output 0

very

grateful

for

your

cry

honored

very

much.

N-grams

very

grateful

for

your

cry

honored

very

much.

for

your

for your

Output 1

your

praise

honored

N-grams

to	your	praise	be	honored	.
	your

Output 2

Thanks

your

great

pleasure

praise.

N-grams

Thanks	to	your	great	pleasure	praise.
Thanks		your

Output 3

very

grateful

for

your

cry

honored

very

much.

N-grams

very

grateful

for

your

cry

honored

very

much.

for

your

for your

Output 4

indebted

your

praise

honored.

N-grams

Is	indebted	your	praise	to	be	honored.
		your

Sentence 228) BLEU: 0 (0.1667/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

��ڥ�

�C

Ref 0

I'd

pineapple

juice,

please.

Ref 1

I'd

some

pineapple

juice,

please.

Ref 2

want

some

pineapple

juice,

please.

Ref 3

I'll

have

pineapple

juice,

please.

Ref 4

would

pineapple

juice,

please.

Ref 5

would

some

pineapple

juice,

please.

Output 0

Please

give

pineapple

juice.

N-grams

Please	give	me	a	pineapple	juice.
				pineapple

Output 1

please

give

pineapple

juice

N-grams

please	give	me	pineapple	juice	.
			pineapple

Output 2

Please

give

pineapple

juice.

N-grams

Please	give	me	a	pineapple	juice.
				pineapple

Output 3

Please

give

juice

Luo.

N-grams

Please

give

juice

Luo.

Output 4

Please

give

the

pineapple

juice.

N-grams

Please	give	me	the	pineapple	juice.
				pineapple

Sentence 229) BLEU: 0 (0.3333/0.2/0/0) ; 0 (0.4/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.3333/0.2/0/0)

Source

��

�A

�d

�@�U

�b��

��

�H

Ref 0

Would

you

check

the

bill

again,

please?

Ref 1

Could

you

check

the

bill

again,

please?

Ref 2

you

mind

checking

the

bill

again,

please?

Ref 3

Could

you

recheck

the

bill,

please?

Ref 4

Would

you

recheck

the

bill,

please?

Ref 5

Would

you

check

the

bill

one

time,

please?

Output 0

Can

look

the

bill

again?

N-grams

Can	look	up	the	bill	again?
			the	bill
			the bill

Output 1

can

check

bill

again

N-grams

can	check	bill	again	?
	check	bill

Output 2

Billing

can

check

it?

N-grams

Billing	can	check	it?
		check

Output 3

Can

check

bill

again?

N-grams

Can	check	a	bill	again?
	check		bill

Output 4

Can

look

the

bill

again?

N-grams

Can	look	up	the	bill	again?
			the	bill
			the bill

Sentence 230) BLEU: 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0)

Source

��

�H

Ref 0

Where

to?

Ref 1

Where

to?

Ref 2

Where

would

you

go?

Ref 3

Where

you

want

go?

Ref 4

Where

to?

Ref 5

What's

the

destination?

Output 0

Where?

N-grams

Where?

Output 1

where

N-grams

where	to	?
	to

Output 2

Where?

N-grams

Where?

Output 3

where?

N-grams

Go	to	where?
	to

Output 4

where?

N-grams

where?

Sentence 231) BLEU: 0 (0.7143/0.3333/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.5714/0.3333/0/0) ; 0 (0.7143/0.3333/0/0)

Source

��

�n

�@��

�M

�Q��

��~

�C

Ref 0

Please

take

your

passport

and

valuables

with

you.

Ref 1

Take

your

passport

and

valuables

with

you,

please.

Ref 2

Please

not

forget

your

passport

and

valuables.

Ref 3

Please

keep

your

passport

and

valuables

with

you.

Ref 4

Please

take

your

passport

and

valuables

with

you.

Ref 5

Please

take

your

passport

and

your

valuables

with

you.

Output 0

Please

take

the

passport

and

the

valuables.

N-grams

Please	take	the	passport	and	the	valuables.
Please	take		passport	and		valuables.
Please take			passport and

Output 1

please

and

valuables

take

passport

N-grams

please	and	valuables	take	passport	.
	and	valuables	take	passport
	and valuables

Output 2

Please

Collect

passports

and

valuables.

N-grams

Please	Collect	passports	and	valuables.
Please			and	valuables.
			and valuables.

Output 3

Please

take

good

passport

and

valuable

article.

N-grams

Please	take	good	passport	and	valuable	article.
Please	take		passport	and
Please take			passport and

Output 4

Please

take

the

passport

and

the

valuables.

N-grams

Please	take	the	passport	and	the	valuables.
Please	take		passport	and		valuables.
Please take			passport and

Sentence 232) BLEU: 0 (0.25/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

We'll

expecting

you.

Ref 1

We'll

expecting

you.

Ref 2

We'll

waiting

for

you.

Ref 3

will

expecting

you.

Ref 4

We'll

expecting

you.

Ref 5

We'll

expecting

you.

Output 0

was

waiting

for.

N-grams

I	was	waiting	for.
		waiting

Output 1

waiting

for

N-grams

i	waiting	for	.
	waiting	for
	waiting for

Output 2

was

waiting

for.

N-grams

I	was	waiting	for.
		waiting

Output 3

wait

for.

N-grams

wait

for.

Output 4

waiting.

N-grams

waiting.

Sentence 233) BLEU: 0 (1/0.5/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0.5/0/0) ; 0 (0.3333/0/0/0)

Source

��

�Z��

��

�H

Ref 0

you

have

restroom?

Ref 1

you

have

bathroom?

Ref 2

Have

you

got

toilet?

Ref 3

you

have

public

restroom?

Ref 4

there

restroom

here?

Ref 5

you

have

public

bathroom?

Output 0

there

toilet?

N-grams

Is	there	toilet?
Is	there	toilet?
Is there

Output 1

toilet

has

N-grams

toilet

has

Output 2

Toilet

has

it?

N-grams

Toilet

has

it?

Output 3

there

toilet?

N-grams

Is	there	toilet?
Is	there	toilet?
Is there

Output 4

Has

the

restroom?

N-grams

Has	the	restroom?
		restroom?

Sentence 234) BLEU: 0 (0.4286/0.1667/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.1429/0/0/0)

Source

��

�n

��

�ж�

�C

Ref 0

would

room

with

good

view,

please.

Ref 1

would

prefer

room

with

good

view,

please.

Ref 2

would

room

with

panoramic

view.

Ref 3

want

room

with

good

view,

please.

Ref 4

I'd

room

with

good

view,

please.

Ref 5

would

room

with

nice

view,

please.

Output 0

Please

give

nice

room

landscape.

N-grams

Please	give	me	a	nice	room	landscape.
			a	nice	room
			a nice

Output 1

please

give

room

the

scenery

good

N-grams

please	give	me	room	the	scenery	good	.
			room			good

Output 2

Please

give

nice

room

landscape.

N-grams

Please	give	me	a	nice	room	landscape.
			a	nice	room
			a nice

Output 3

Please

give

the

scenery

good

room.

N-grams

Please	give	me	the	scenery	good	room.
					good

Output 4

Please

give

the

scenery

good

room.

N-grams

Please	give	me	the	scenery	good	room.
					good

Sentence 235) BLEU: 0 (0.75/0.4286/0.1667/0) ; 0 (0.5/0.2/0/0) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.3333/0/0/0) ; 0 (0.4/0.1111/0/0)

Source

��

�Q

��

�Ƴ��O

�M

�Ƴ��u

�C

Ref 0

Rental

skis

and

boots

please.

Ref 1

Please,

rental

skis

and

boots.

Ref 2

Rental

skis

and

boots

please.

Ref 3

need

rent

skis

and

boots

please.

Ref 4

I'd

rent

skis

and

boots,

please.

Ref 5

Skis

and

boots

rent

please.

Output 0

would

take

skis

and

boots.

N-grams

I	would	like	to	take	skis	and	boots.
I		like	to		skis	and	boots.
		like to			skis and
					skis and boots.
						and boots.

Output 1

skis

and

want

N-grams

i	to	skis	and	want	.
	to	skis	and
		skis and

Output 2

would

take

skis

and

boots.

N-grams

I	would	like	to	take	skis	and	boots.
I		like	to		skis	and	boots.
		like to			skis and
					skis and boots.
						and boots.

Output 3

want

lend

skiing

plank

and

skiing

Xue.

N-grams

I	want	to	lend	skiing	plank	and	skiing	Xue.
I		to				and

Output 4

want

borrow

the

skis

and

the

ski

boot.

N-grams

I	want	to	borrow	the	skis	and	the	ski	boot.
I		to			skis	and
					skis and

Sentence 236) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (1/0.5/0/0) ; 0 (0.5/0.3333/0/0)

Source

��

�Q

�n

�Ԥl

�C

Ref 0

I'd

mattress.

Ref 1

would

mattress.

Ref 2

want

mattress.

Ref 3

I'd

mattress.

Ref 4

I'd

mattress.

Ref 5

May

have

mattress?

Output 0

I'd

mat.

N-grams

I'd	like	mat.
I'd	like
I'd like

Output 1

want

N-grams

i	want	.
	want

Output 2

I'd

mat.

N-grams

I'd	like	mat.
I'd	like
I'd like

Output 3

want

mattress.

N-grams

I	want	mattress.
I	want	mattress.
I want

Output 4

want

the

cushion.

N-grams

I	want	the	cushion.
I	want
I want

Sentence 237) BLEU: 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 1 (1/1/1/1) ; 0 (0.375/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

ı�o

��

�o

��

�C

Ref 0

think

Jane's

right.

Ref 1

believe

that

Jane

right.

Ref 2

agree

with

Jane.

Ref 3

think

that

Jane

correct.

Ref 4

think

Jane

right.

Ref 5

think

that

Jane

right.

Output 0

think

Jane

right.

N-grams

I	think	Jane	is	right.
I	think	Jane	is	right.
I think		Jane is
I think Jane			is right.
I think Jane is
	think Jane
	think Jane is
	think Jane is right.
		Jane is right.

Output 1

that

N-grams

i	that	.
	that

Output 2

think

Jane

right.

N-grams

I	think	Jane	is	right.
I	think	Jane	is	right.
I think		Jane is
I think Jane			is right.
I think Jane is
	think Jane
	think Jane is
	think Jane is right.
		Jane is right.

Output 3

feel

that

Chien

cans

say

that

again.

N-grams

I	feel	that	Chien	cans	say	that	again.
I		that

Output 4

thought

that

Jan

said

rightly.

N-grams

I	thought	that	Jan	said	rightly.
I		that

Sentence 238) BLEU: 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�ж�

��

�H

Ref 0

possible

change

rooms?

Ref 1

Would

possible

exchange

rooms?

Ref 2

Can

the

rooms

changed?

Ref 3

Would

possible

for

change

rooms?

Ref 4

Would

possible

change

rooms?

Ref 5

Can

change

rooms?

Output 0

Give

another

room?

N-grams

Give	me	another	room?
	me

Output 1

room

can

N-grams

me	room	can	a	?
me

Output 2

Give

another

room?

N-grams

Give	me	another	room?
	me

Output 3

Can

change

room

for

me?

N-grams

Can	change	a	room	for	me?
Can	change			for

Output 4

Can

trade

room

me?

N-grams

Can	trade	a	room	to	me?
Can				to

Sentence 239) BLEU: 0 (0.125/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0/0/0/0)

Source

��

�o

�i

�B��

�t��

�C

Ref 0

Here's

prescription.

Ref 1

Here

prescription.

Ref 2

This

medical

prescription.

Ref 3

Here's

prescription.

Ref 4

Here's

prescription.

Ref 5

Here's

prescription.

Output 0

Please

press

this

prescription

fill

prescription.

N-grams

Please	press	this	prescription	to	fill	a	prescription.
							prescription.

Output 1

please

this

prescription

press

N-grams

please

this

prescription

press

Output 2

Please

click

this

prescription.

N-grams

Please	click	this	prescription.
			prescription.

Output 3

Please

press

this

prescription

fill

prescription.

N-grams

Please	press	this	prescription	to	fill	a	prescription.
							prescription.

Output 4

Please

press

this

prescription

dispensing.

N-grams

Please

press

this

prescription

dispensing.

Sentence 240) BLEU: 0 (0.8/0.5/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.8/0.5/0/0) ; 0 (0.25/0/0/0)

Source

�o

�O��

�]�A

�O�I

��

�H

Ref 0

insurance

included?

Ref 1

insurance

included?

Ref 2

Does

include

the

insurance?

Ref 3

Does

include

insurance?

Ref 4

Does

this

include

insurance?

Ref 5

Does

that

include

insurance?

Output 0

Does

this

expenses

include

insurance?

N-grams

Does	this	expenses	include	insurance?
Does	this		include	insurance?
Does this			include insurance?

Output 1

this

insurance

N-grams

this	insurance	?
this	insurance

Output 2

This

cost

includes

insurance?

N-grams

This	cost	includes	insurance?
			insurance?

Output 3

Does

this

expenses

include

insurance?

N-grams

Does	this	expenses	include	insurance?
Does	this		include	insurance?
Does this			include insurance?

Output 4

This

expense

including

insurance?

N-grams

This	expense	including	insurance?
			insurance?

Sentence 241) BLEU: 0 (0.5455/0.2/0.1111/0) ; 0 (0.4444/0.125/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.6667/0.375/0.1429/0) ; 0 (0.5455/0.2/0.1111/0)

Source

��

�Q

�b

�í�

�d�i

��

�R��

�C

Ref 0

think

you

can

buy

the

furniture

section.

Ref 1

believe

that

you

can

buy

the

furniture

section.

Ref 2

believe

you

can

find

the

furniture

department.

Ref 3

think

that

can

purchased

the

furniture

section.

Ref 4

think

you

can

purchase

the

furniture

section.

Ref 5

think

you

can

buy

the

furniture

department.

Output 0

want

able

buy

the

furniture

counter.

N-grams

I	want	to	be	able	to	buy	in	the	furniture	counter.
I			be			buy	in	the	furniture
							in the
							in the furniture
								the furniture

Output 1

buy

furniture

want

the

counter

N-grams

i	to	buy	furniture	want	in	the	counter	.
		buy	furniture		in	the
					in the

Output 2

would

buy

furniture

counters.

N-grams

I	would	like	to	buy	furniture	counters.
I				buy	furniture

Output 3

want

can

buy

the

furniture

counter.

N-grams

I	want	to	can	buy	in	the	furniture	counter.
I			can	buy	in	the	furniture
			can buy		in the
					in the furniture
						the furniture

Output 4

want

able

buy

the

furniture

counter.

N-grams

I	want	to	be	able	to	buy	in	the	furniture	counter.
I			be			buy	in	the	furniture
							in the
							in the furniture
								the furniture

Sentence 242) BLEU: 0 (0.7143/0.3333/0.2/0) ; 0 (0.25/0/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�h

�ݰ�

�e�x

�a

�C

Ref 0

Then

let

check

the

front

desk.

Ref 1

Then

let

check

the

front

desk.

Ref 2

Then

I'll

check

with

the

reception.

Ref 3

Then

let

check

for

you

the

front

desk.

Ref 4

Let

check

the

front

desk,

then.

Ref 5

Just

let

check

the

front

desk

then.

Output 0

Then

you

ask

the

front

desk.

N-grams

Then	you	go	ask	the	front	desk.
Then	you			the	front	desk.
				the front
				the front desk.
					front desk.

Output 1

then

ask

the

N-grams

then	ask	the	.
		the

Output 2

Then

you

ask

the

front

desk.

N-grams

Then	you	go	ask	the	front	desk.
Then	you			the	front	desk.
				the front
				the front desk.
					front desk.

Output 3

ask

ex-

set.

N-grams

ask

ex-

set.

Output 4

Then

asks

the

onstage.

N-grams

Then	asks	the	onstage.
Then		the

Sentence 243) BLEU: 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0)

Source

�]�t

�O�I

��

�H

Ref 0

Does

include

insurance?

Ref 1

insurance

included?

Ref 2

the

insurance

included?

Ref 3

Does

include

insurance?

Ref 4

Does

include

insurance?

Ref 5

Does

that

include

insurance?

Output 0

Include

insurance?

N-grams

Include	insurance?
	insurance?

Output 1

insurance

N-grams

insurance	?
insurance

Output 2

Includes

insurance?

N-grams

Includes	insurance?
	insurance?

Output 3

Include

insurance?

N-grams

Include	insurance?
	insurance?

Output 4

Contains

the

insurance?

N-grams

Contains	the	insurance?
	the	insurance?

Sentence 244) BLEU: 0 (1/0.5/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (1/0.5/0/0) ; 0 (0/0/0/0)

Source

�X�I

��^

�H

Ref 0

What

time

get

back?

Ref 1

What

time

return?

Ref 2

What

time

get

back?

Ref 3

what

time

will

return?

Ref 4

What

time

get

back?

Ref 5

When

get

back?

Output 0

What

time

return?

N-grams

What	time	return?
What	time	return?
What time

Output 1

N-grams

Output 2

few

points

back?

N-grams

A	few	points	back?
			back?

Output 3

What

time

return?

N-grams

What	time	return?
What	time	return?
What time

Output 4

How

many

returnses?

N-grams

How

many

returnses?

Sentence 245) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0/0/0/0)

Source

��ַ

�X�I

�}�l

�H

Ref 0

What

time

does

the

concert

begin?

Ref 1

When

does

the

concert

begin?

Ref 2

When

does

the

concert

start?

Ref 3

what

time

will

the

concert

start?

Ref 4

what

time

does

the

concert

start?

Ref 5

what

time

does

the

concert

begin?

Output 0

Some

concerts

start?

N-grams

Some	concerts	start?
		start?

Output 1

start

concert

N-grams

start	concert	?
	concert

Output 2

Some

concerts

start?

N-grams

Some	concerts	start?
		start?

Output 3

Concert

what

time

start?

N-grams

Concert	what	time	start?
	what	time	start?
	what time

Output 4

Concert

how

many

starts?

N-grams

Concert

how

many

starts?

Sentence 246) BLEU: 0 (0.5455/0.1/0/0) ; 0 (0.5455/0/0/0) ; 0 (0.5455/0.1/0/0) ; 0 (0.6667/0.3636/0.1/0) ; 0 (0.4167/0.09091/0/0)

Source

�o��

�@

�Q

��

�W��

�]

�ѰO

�g

�W�r

�F

�C

Ref 0

Come

think

it,

forgot

sign

name

last

time.

Ref 1

Come

think

it,

last

time

forgot

sign

name.

Ref 2

Now

that

comes

mind,

did

not

sign

name

last

time.

Ref 3

Now

that

think

it,

didn't

remember

sign

name

last

time.

Ref 4

reflection,

forgot

sign

name

last

time.

Ref 5

Come

think

it,

did

forget

sign

name

last

time.

Output 0

This

one

also

want

forget

write

last

name.

N-grams

This	one	also	want	to	forget	to	write	my	last	name.
				to	forget	to		my	last	name.
					forget to

Output 1

one

also

write

last

name

that

forgot

time

N-grams

one	also	to	write	last	name	that	i	forgot	time	.
		to		last	name	that		forgot	time

Output 2

This

one

also

want

forget

write

last

name.

N-grams

This	one	also	want	to	forget	to	write	my	last	name.
				to	forget	to		my	last	name.
					forget to

Output 3

think

that

also

forgot

write

name

last

time.

N-grams

So	a	think	that	I	also	forgot	to	write	name	last	time.
		think	that	I		forgot	to		name	last	time.
			that I			forgot to			name last
									name last time.
										last time.

Output 4

Such

one

thought

that

time

also

forgot

wrote

the

name.

N-grams

Such	one	thought	that	I	previous	time	also	forgot	wrote	the	name.
			that	I		time		forgot			name.
			that I

Sentence 247) BLEU: 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�C

�h��

��

�H

Ref 0

Thank

you.
How

much

it?

Ref 1

Thank

you.
How

much

it?

Ref 2

Thanks.
How

much?

Ref 3

Thank

you.
How

much

it?

Ref 4

Thanks.
How

much

does

cost?

Ref 5

Thank

you.
How

much

does

cost?

Output 0

Thanks.

How

much

money?

N-grams

Thanks.	How	much	money?
Thanks.		much

Output 1

how

much

N-grams

how	much	?
	much

Output 2

謝謝.

How

much

it?

N-grams

謝謝.	How	much	is	it?
		much	is	it?
		much is
		much is it?
			is it?

Output 3

Thank.

How

much

N-grams

Thank.	How	much	?
		much

Output 4

Thanks.

How

much

money?

N-grams

Thanks.	How	much	money?
Thanks.		much

Sentence 248) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�u�r

�o

�u

�O

��

�i�R

�F

�C

Ref 0

Oh,

aren't

these

cute.

Ref 1

Oh,

aren't

these

very

cute?

Ref 2

Wow,

ain't

these

cute.

Ref 3

Oh,

aren't

these

adorable.

Ref 4

Oh,

these

are

cute.

Ref 5

Oh,

these

are

cute,

aren't

they?

Output 0

this

really

sweet.

N-grams

this

really

sweet.

Output 1

this

really

was

too

N-grams

this

really

was

too

Output 2

this

really

sweet.

N-grams

this

really

sweet.

Output 3

this

was

really

too

lovely.

N-grams

this

was

really

too

lovely.

Output 4

this

was

really

too

lovable.

N-grams

this

was

really

too

lovable.

Sentence 249) BLEU: 0 (0.625/0.2/0/0) ; 0 (0.5833/0.09091/0/0) ; 0 (0.5/0.07692/0/0) ; 0 (0.625/0.2/0/0) ; 0 (0.5625/0.2/0.07143/0)

Source

��

�Ȯ�

�C

�ڭ�

�D�`

�M��

��~

�O

��n

��

�@�~

�C

Ref 0

Don't

mention

it,

Mr.

Shirane.
We

know

very

well

that

will

important

year.

Ref 1

need

mention

it,

Mr.

Shirane.
We

know

very

well

that

will

important

year.

Ref 2

Don't

mention

it,

Mr.

Shirane.
We

acknowledge

that

this

year

will

important.

Ref 3

need

say

it,

Mr.

Shirane.
We

are

fully

aware

that

will

highly

significant

year.

Ref 4

It's

nothing,

Mr.

Shirane.
We

know

very

well

that

will

important

year.

Ref 5

You're

very

welcome,

Mr.

Shirane.
We

understand

very

well

that

will

important

year.

Output 0

Don't

need

polite.

know

very

much

that

the

year

important

year.

N-grams

Don't

need

polite.

know

very

much

that

the

year

important

year.

Don't

need

know

very

that

year

important

year.

need to

know very

important year.

Output 1

not

very

important

year

need

polite

N-grams

not	we	very	important	year	next	year	need	to	be	polite	.
		very	important	year			need	to	be
							need to

Output 2

not

hesitate.

are

very

clearly

are

important

year

for

year.

N-grams

not

hesitate.

are

very

clearly

are

important

year

for

year.

are

very

important

year

year.

an important

Output 3

Don't

need

polite.

know

very

much

that

the

year

important

year.

N-grams

Don't

need

polite.

know

very

much

that

the

year

important

year.

Don't

need

know

very

that

year

important

year.

need to

know very

important year.

Output 4

Does

not

need

polite.

Our

very

clear

year

will

important

one

year.

N-grams

Does

not

need

polite.

Our

very

clear

year

will

important

one

year.

need

very

year

will

important

year.

need to

year will

year will be

will be

Sentence 250) BLEU: 0 (0.7143/0.3333/0.2/0) ; 0 (0.6/0.25/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0)

Source

�p�G

��

�o��

�p��

�C

Ref 0

you

find

contact

here,

please.

Ref 1

Please

contact

here,

you

find

it.

Ref 2

Please

contact

this

address

you

find

it.

Ref 3

you

come

across

it,

you

can

reach

here,

please.

Ref 4

you

find

it,

please

contact

here.

Ref 5

you

find

it,

please

get

touch

with

here.

Output 0

you

find

here,

then

please

contact.

N-grams

If	you	find	here,	then	please	contact.
If	you	find	here,		please
If you
If you find
	you find

Output 1

here

please

contact

N-grams

if	here	please	contact	.
if		please	contact
		please contact

Output 2

you

find

here,

then

please

contact.

N-grams

If	you	find	here,	then	please	contact.
If	you	find	here,		please
If you
If you find
	you find

Output 3

the

words

finding

out

ask

and

contact

here.

N-grams

If	the	words	finding	out	ask	and	contact	here.
If							contact	here.

Output 4

found

please

with

here

contact.

N-grams

If	found	please	with	here	contact.
If		please	with

Sentence 251) BLEU: 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1818/0/0/0) ; 0 (0.4444/0/0/0)

Source

�h

�J��S��

��

�H

Ref 0

How

get

Covent

Garden?

Ref 1

How

can

get

Covent

Garden?

Ref 2

Can

you

show

the

way

Covent

Garden,

please?

Ref 3

Which

way

Covent

Garden?

Ref 4

Could

you

give

directions

Covent

Garden?

Ref 5

What's

the

best

way

get

Covent

Garden?

Output 0

Grams

the

garden

how

from

here?

N-grams

Grams	of	the	garden	go	how	to	go	from	here?
		the				to

Output 1

the

garden

how

gram

walk

N-grams

the	garden	go	how	to	gram	walk	?
the				to

Output 2

Grams

the

Garden

how

from

here?

N-grams

Grams	of	the	Garden	go	how	to	go	from	here?
		the				to

Output 3

gram

originally

especially

how

should

the

garden

walk?

N-grams

Go	to	a	gram	originally	especially	how	should	the	garden	walk?
	to							the

Output 4

How

goes

the

gram

Bent

garden

walk?

N-grams

How	goes	to	the	gram	Bent	garden	to	walk?
How		to	the				to

Sentence 252) BLEU: 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0)

Source

�O

��q

�ƬG

�C

Ref 0

There's

been

accident.

Ref 1

There

has

been

accident.

Ref 2

accident

has

occurred.

Ref 3

There's

been

accident.

Ref 4

There's

been

accident.

Ref 5

There

was

accident.

Output 0

the

traffic

accident.

N-grams

Is	the	traffic	accident.
			accident.

Output 1

traffic

accident

N-grams

traffic	is	accident	.
		accident

Output 2

Are

traffic

accidents.

N-grams

Are

traffic

accidents.

Output 3

transportation

accident.

N-grams

It	is	a	transportation	accident.
				accident.

Output 4

the

traffic

accident.

N-grams

Is	the	traffic	accident.
			accident.

Sentence 253) BLEU: 0 (0.25/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4286/0/0/0)

Source

��

�i

�j�H��

�@

�i

�ൣ��

�C

Ref 0

Two

adults

and

one

child.

Ref 1

Two

adults

and

one

child.

Ref 2

Two

adults

and

child.

Ref 3

Two

adults

and

one

child.

Ref 4

Two

adults

and

one

child.

Ref 5

One

child

and

two

adults.

Output 0

Two

open

widely

person's

ticket

child's

ticket.

N-grams

Two	open	widely	person's	ticket	a	child's	ticket.
Two					a

Output 1

child

ticket

two

person

N-grams

child	ticket	ticket	two	person	a	.
child			two		a

Output 2

adults

and

child

ticket

ticket.

N-grams

2	adults	and	1	child	ticket	ticket.
	adults	and		child
	adults and

Output 3

Two

open

widely

person's

ticket

child's

ticket.

N-grams

Two	open	widely	person's	ticket	a	child's	ticket.
Two					a

Output 4

Two

publicize

person

ticket

child

ticket.

N-grams

Two	publicize	a	person	ticket	child	ticket.
Two		a			child

Sentence 254) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.2/0/0/0)

Source

�z

ı�o

��

�H

Ref 0

How

you

it?

Ref 1

What

you

think

about

it?

Ref 2

you

it?

Ref 3

How

you

it?

Ref 4

How

you

it?

Ref 5

What

you

think

it?

Output 0

How

you

feel?

N-grams

How	do	you	feel?
How	do	you
How do
How do you
	do you

Output 1

what

you

N-grams

what	do	you	?
	do	you
	do you

Output 2

What

you

say?

N-grams

What	do	you	say?
What	do	you
What do
What do you
	do you

Output 3

How

you

feel?

N-grams

How	do	you	feel?
How	do	you
How do
How do you
	do you

Output 4

You

think

what

kind

of?

N-grams

You	think	what	kind	of?
	think

Sentence 255) BLEU: 0 (1/0.25/0/0) ; 0 (0.6/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (1/0.25/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�i�H

�~��

�H

Ref 0

Where

can

get

car

washed?

Ref 1

Where

could

have

car

washed?

Ref 2

Where

can

wash

car?

Ref 3

there

carwash

nearby?

Ref 4

Where

can

have

car

washed?

Ref 5

Where

can

get

car

washed?

Output 0

Where

can

wash

car?

N-grams

Where	can	wash	a	car?
Where	can	wash	a	car?
Where can

Output 1

where

can

car

wash

N-grams

where	can	car	wash	?
	can	car	wash

Output 2

Where

can

car

wash?

N-grams

Where	can	car	wash?
Where	can	car
Where can

Output 3

Where

can

wash

car?

N-grams

Where	can	wash	a	car?
Where	can	wash	a	car?
Where can

Output 4

Where

can

the

car

wash?

N-grams

Where	can	the	car	wash?
Where	can		car
Where can

Sentence 256) BLEU: 0 (0.4/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.4/0/0/0)

Source

�o

��

�O

��

�H

Ref 0

this

necklace

gold?

Ref 1

this

necklace

made

gold?

Ref 2

this

gold

necklace?

Ref 3

this

necklace

made

real

gold?

Ref 4

this

necklace

gold?

Ref 5

this

necklace

gold?

Output 0

This

necklace

the

gold?

N-grams

This	necklace	is	the	gold?
	necklace			gold?

Output 1

this

necklace

gold

N-grams

this	necklace	is	gold	?
this	necklace		gold
this necklace

Output 2

This

necklace

gold

it?

N-grams

This	necklace	is	gold	it?
	necklace		gold

Output 3

this

clausal

chain

golden?

N-grams

Is	this	clausal	chain	golden?
Is	this
Is this

Output 4

This

necklace

the

gold?

N-grams

This	necklace	is	the	gold?
	necklace			gold?

Sentence 257) BLEU: 0 (0.3/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1/0/0/0)

Source

��

�I

�C

��M

��

�N

��

�W

��

�F

�C

Ref 0

Hurry

up.
Or

I'll

late

for

the

flight.

Ref 1

Quickly.
Or

will

late

for

the

flight.

Ref 2

Come

on.
Or

I'm

going

late

for

the

flight.

Ref 3

Move

it.
Or

I'll

miss

the

flight.

Ref 4

Hurry

will

late

for

the

flight.

Ref 5

Please

quick

I'll

late

for

the

flight.

Output 0

Quickly.

Otherwise

the

car

can

not

keep

with

the.

N-grams

Quickly.	Otherwise	the	car	can	not	keep	up	with	the.
Quickly.		the					up

Output 1

otherwise

the

car

not

with

N-grams

otherwise	the	car	not	up	with	a	.
	the			up

Output 2

Quickly.

Otherwise

the

car

can

not

keep

with

the.

N-grams

Quickly.	Otherwise	the	car	can	not	keep	up	with	the.
Quickly.		the					up

Output 3

Hurry.

Otherwise

the

words

failed

catch

car.

N-grams

Hurry.	Otherwise	of	the	words	failed	to	catch	a	car.
			the			to

Output 4

bit

faster.

Otherwise

catches

with

does

not

board.

N-grams

A	bit	faster.	Otherwise	catches	up	with	does	not	board.
					up

Sentence 258) BLEU: 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.3333/0.25/0.1429/0) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.625/0.2857/0.1667/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�@

�M

��

�H

Ref 0

Can

have

cup

tea?

Ref 1

Could

have

cup

tea?

Ref 2

would

appreciate

cup

tea.

Ref 3

Could

have

some

tea?

Ref 4

Can

have

cup

tea?

Ref 5

May

have

cup

tea?

Output 0

You

give

cup

tea?

N-grams

You	give	me	a	cup	of	tea?
			a	cup	of	tea?
			a cup		of tea?
			a cup of
			a cup of tea?
				cup of
				cup of tea?

Output 1

give

cup

tea

can

black

N-grams

give	me	a	cup	of	tea	can	black	?
		a	cup	of
		a cup
		a cup of
			cup of

Output 2

You

give

cup

tea?

N-grams

You	give	me	a	cup	of	tea?
			a	cup	of	tea?
			a cup		of tea?
			a cup of
			a cup of tea?
				cup of
				cup of tea?

Output 3

Can

give

cup

black

tea?

N-grams

Can	give	me	a	cup	of	black	tea?
Can			a	cup	of		tea?
			a cup
			a cup of
				cup of

Output 4

Can

give

cup

black

teas?

N-grams

Can	give	me	cup	of	black	teas?
Can			cup	of
			cup of

Sentence 259) BLEU: 1 (1/1/1/1) ; 0 (0.5714/0.1667/0/0) ; 1 (1/1/1/1) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.6667/0.4/0.25/0)

Source

�O�I�O

�O

�h��

�H

Ref 0

How

much

for

insurance?

Ref 1

How

much

does

insurance

cost?

Ref 2

What

are

the

insurance

costs?

Ref 3

How

much

would

insurance

cost?

Ref 4

How

much

insurance?

Ref 5

How

much

does

the

insurance

cost?

Output 0

How

much

insurance?

N-grams

How	much	is	insurance?
How	much	is	insurance?
How much		is insurance?
How much is
How much is insurance?
	much is
	much is insurance?

Output 1

how

much

insurance

the

premium

N-grams

how	much	is	insurance	the	premium	?
	much	is	insurance	the
	much is

Output 2

How

much

insurance?

N-grams

How	much	is	insurance?
How	much	is	insurance?
How much		is insurance?
How much is
How much is insurance?
	much is
	much is insurance?

Output 3

How

much

the

premium

N-grams

How	much	is	the	premium	?
How	much	is	the
How much
How much is
	much is

Output 4

How

many

are

the

insurance

premium?

N-grams

How	many	are	the	insurance	premium?
How		are	the	insurance
		are the
		are the insurance
			the insurance

Sentence 260) BLEU: 0 (0.1667/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.4/0/0/0)

Source

�̭�

��

�O

��

�H

Ref 0

What's

inside?

Ref 1

What

inside?

Ref 2

What

the

inside?

Ref 3

What

there?

Ref 4

What's

inside?

Ref 5

What

does

contain?

Output 0

what

pack?

N-grams

In	what	is	what	to	pack?
		is

Output 1

what

inside

what

N-grams

what	is	inside	what	?
	is

Output 2

What

mounted

inside?

N-grams

What	is	mounted	inside?
What	is		inside?
What is

Output 3

what

pack

N-grams

In	what	is	what	to	pack	?
		is

Output 4

What

inside

installs

what?

N-grams

What	inside	installs	is	what?
What			is

Sentence 261) BLEU: 1 (1/1/1/1) ; 0 (0.6/0/0/0) ; 1 (1/1/1/1) ; 0 (0.5556/0.125/0/0) ; 0 (0.25/0/0/0)

Source

�o

�O

�e

��

�B��

��

§��

�C

Ref 0

This

gift

for

friend.

Ref 1

This

present

for

friend.

Ref 2

It's

present

for

friend.

Ref 3

This

present

that

got

for

friend.

Ref 4

This

gift

for

friend.

Ref 5

This

gift

for

friend

mine.

Output 0

This

gift

for

friend.

N-grams

This	is	a	gift	for	a	friend.
This	is	a	gift	for	a	friend.
This is		a gift		for a
This is a			gift for		a friend.
This is a gift				for a friend.
	is a		gift for a
	is a gift
	is a gift for
		a gift for
		a gift for a
			gift for a friend.

Output 1

this

gift

friend

N-grams

this	is	gift	friend	.
	is	gift	friend

Output 2

This

gift

for

friend.

N-grams

This	is	a	gift	for	a	friend.
This	is	a	gift	for	a	friend.
This is		a gift		for a
This is a			gift for		a friend.
This is a gift				for a friend.
	is a		gift for a
	is a gift
	is a gift for
		a gift for
		a gift for a
			gift for a friend.

Output 3

This

the

gift

that

sends

the

friend.

N-grams

This	is	the	gift	that	sends	to	the	friend.
This	is		gift	that				friend.
This is

Output 4

This

gives

friend's

gift.

N-grams

This	gives	friend's	gift.
This

Sentence 262) BLEU: 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0)

Source

��

�H

��

�I

��

�s

��@��

�I

Ref 0

Somebody,

call

ambulance.

Ref 1

Somebody,

call

ambulance.

Ref 2

Somebody,

call

for

ambulance.

Ref 3

Somebody,

send

for

ambulance.

Ref 4

Someone,

call

ambulance.

Ref 5

Please

call

ambulance,

somebody.

Output 0

Comes

the

Human!

called

the

ambulance

quickly!

N-grams

Comes

the

Human!

called

the

ambulance

quickly!

Output 1

call

ambulance

quick

N-grams

!	call	ambulance	quick	!
	call

Output 2

Come

ah!

Call

ambulance

quick!

N-grams

Come	ah!	Call	an	ambulance	quick!
			an

Output 3

Bearer!

Quick

call

ambulance!

N-grams

Bearer!	Quick	call	ambulance!
		call

Output 4

Comes

the

human!

called

the

ambulance

quickly!

N-grams

Comes

the

human!

called

the

ambulance

quickly!

Sentence 263) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�I��

�M�H

��

�F��

�C

Ref 0

Something

not

heavy,

please.

Ref 1

Please,

something

not

heavy.

Ref 2

Something

light,

please.

Ref 3

Something

not

heavy,

please.

Ref 4

Please,

something

light.

Ref 5

Something

that

not

heavy,

please.

Output 0

Please

give

some

light

things.

N-grams

Please

give

some

light

things.

Output 1

please

give

light

the

thing

N-grams

please

give

light

the

thing

Output 2

Please

give

some

light

things.

N-grams

Please

give

some

light

things.

Output 3

Please

order

the

son

simple

elegance

thing

for

me.

N-grams

Please

order

the

son

simple

elegance

thing

for

me.

Output 4

Please

give

select

the

light

thing.

N-grams

Please

give

select

the

light

thing.

Sentence 264) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0.4/0.25/0) ; 0 (1/0.6667/0.5/0) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 0.7598 (0.8333/0.8/0.75/0.6667)

Source

�l��

�b

��

�H

Ref 0

Where

the

post

office?

Ref 1

Where

the

post

office

located?

Ref 2

Can

you

show

the

way

the

post

office?

Ref 3

How

get

the

post

office?

Ref 4

Where's

the

post

office?

Ref 5

Where

the

post

office

situated?

Output 0

Where

the

post

office?

N-grams

Where	is	the	post	office?
Where	is	the	post	office?
Where is		the post
Where is the			post office?
Where is the post
	is the
	is the post
	is the post office?
		the post office?

Output 1

where

the

post

office

N-grams

where	the	post	office	is	?
	the	post	office	is
	the post
	the post office
		post office

Output 2

Where

the

post

office?

N-grams

Where	the	post	office?
Where	the	post	office?
	the post
	the post office?
		post office?

Output 3

Where

the

post

office

N-grams

Where	is	the	post	office	?
Where	is	the	post	office
Where is		the post
Where is the			post office
Where is the post
	is the
	is the post
	is the post office
		the post office

Output 4

Where

the

post

office

at?

N-grams

Where	is	the	post	office	at?
Where	is	the	post	office
Where is		the post
Where is the			post office
Where is the post
	is the
	is the post
	is the post office
		the post office

Sentence 265) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�{��

�C

Ref 0

cash,

please.

Ref 1

Please,

cash.

Ref 2

Cash,

please.

Ref 3

I'd

prefer

cash,

please.

Ref 4

cash,

please.

Ref 5

Cash

only,

please.

Output 0

With

cash.

N-grams

With	cash.
	cash.

Output 1

with

cash

N-grams

with

cash

Output 2

With

cash.

N-grams

With	cash.
	cash.

Output 3

Use

cash.

N-grams

Use	cash.
	cash.

Output 4

With

cash.

N-grams

With	cash.
	cash.

Sentence 266) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.5556/0.375/0.1429/0) ; 0 (0.375/0.1429/0/0)

Source

�a

�D��

��

��H��

�O

�h��

��

�H

Ref 0

How

much

single

room

with

bath?

Ref 1

How

much

does

single

room

with

bath

cost?

Ref 2

What

the

price

for

single

room

with

bath?

Ref 3

What

the

cost

single

room

with

bath?

Ref 4

How

much

for

single

room

with

bath?

Ref 5

How

much

for

single

room

with

bathroom?

Output 0

Single

room

with

bath

are

how

much

money?

N-grams

Single	room	with	bath	are	how	much	money?
	room	with	bath			much
	room with

Output 1

single

how

much

money

bathtub

N-grams

single	how	much	money	is	bathtub	?
single		much		is

Output 2

Single

room

with

bath

are

how

much

money?

N-grams

Single	room	with	bath	are	how	much	money?
	room	with	bath			much
	room with

Output 3

How

much

the

single

that

brings

bathtub

N-grams

How	much	is	the	single	that	brings	bathtub	?
How	much	is	the	single
How much		is the
How much is
	much is

Output 4

How

much

money

leads

between

bathtub's

single

is?

N-grams

How	much	money	leads	between	bathtub's	single	is?
How	much					single
How much

Sentence 267) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�n

�H�s

��

�ⴣ

��

�C

Ref 0

have

two

pieces

baggage

check.

Ref 1

have

two

pieces

luggage

check.

Ref 2

have

two

bags

check

in.

Ref 3

would

check

two

bags.

Ref 4

have

two

bags

check.

Ref 5

have

two

pieces

luggage

check

in.

Output 0

have

two

the

hand

baggage

storage.

N-grams

To	have	two	of	the	hand	baggage	storage.
	have	two	of			baggage
	have two

Output 1

two

the

hand

baggage

N-grams

two	the	hand	baggage	.
two			baggage

Output 2

have

two

the

hand

baggage

storage.

N-grams

To	have	two	of	the	hand	baggage	storage.
	have	two	of			baggage
	have two

Output 3

The

hand

with

there

are

depositing

lifts

baggage.

N-grams

The

hand

with

there

are

depositing

lifts

baggage.

Output 4

Two

must

check

hand

luggage.

N-grams

Two	must	check	hand	luggage.
		check

Sentence 268) BLEU: 0 (0.1818/0.1/0/0) ; 0 (0/0/0/0) ; 0 (0.1818/0.1/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�s

�a��

�@��

�C

��

�C

Ref 0

Ichiro

Suzuki.
S-U-Z-U-K-I.

Ref 1

Ichiro

Suzuki.
S-U-Z-U-K-I.

Ref 2

Ichiro

Suzuki.
That's

S-U-Z-U-K-I.

Ref 3

Ichiro

Suzuki.
S-U-Z-U-K-I.

Ref 4

Ichiro

Suzuki.
S-U-Z-U-K-I.

Ref 5

Ichiro

Suzuki.
That's

spelled

S-U-Z-U-K-I.

Output 0

name

Ichiro

Suzuki.

N-grams

My	name	is	Ichiro	Suzuki.	S	U	Z	U	K	I.
			Ichiro	Suzuki.
			Ichiro Suzuki.

Output 1

name

N-grams

name

Output 2

name

Ichiro

Suzuki.

N-grams

My	name	is	Ichiro	Suzuki.	S	U	Z	U	K	I.
			Ichiro	Suzuki.
			Ichiro Suzuki.

Output 3

call

bell

wood

one

Lang.

The

��٢�

N-grams

call

bell

wood

one

Lang.

The

��٢�

Output 4

name

Lingmuyilang.

N-grams

name

Lingmuyilang.

Sentence 269) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.8/0.25/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.5/0.1429/0/0)

Source

�z

�a

��G

��

�F

��

�H

Ref 0

you

have

any

fruit

vegetables?

Ref 1

you

have

any

fruit

vegetables?

Ref 2

Have

you

got

any

fruit

vegetables?

Ref 3

you

have

any

fruit

vegetables?

Ref 4

you

have

any

vegetables

fruit?

Ref 5

you

have

any

vegetables

any

fruit?

Output 0

You

have

brought

the

fruit

the

vegetables?

N-grams

You	have	brought	the	fruit	or	the	vegetables?
	have			fruit	or		vegetables?
				fruit or

Output 1

fruit

vegetables

you

N-grams

fruit	or	vegetables	you	?
fruit	or	vegetables	you
fruit or

Output 2

Your

fruit

vegetables

with

it?

N-grams

Your	fruit	or	vegetables	with	it?
	fruit	or	vegetables
	fruit or

Output 3

Did

you

bring

fruit

vegetable?

N-grams

Did	you	bring	fruit	or	vegetable?
	you		fruit	or
			fruit or

Output 4

You

have

brought

the

fruit

the

vegetables?

N-grams

You	have	brought	the	fruit	or	the	vegetables?
	have			fruit	or		vegetables?
				fruit or

Sentence 270) BLEU: 0 (0.25/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.375/0.1429/0/0)

Source

��

�Q

�n

�v

�ζ�

��

�C

Ref 0

I'd

pick

something

for

this

sunburn.

Ref 1

would

get

something

for

this

sunburn.

Ref 2

I'd

pick

something

for

this

sunburn.

Ref 3

would

find

something

treat

this

sunburn.

Ref 4

I'd

get

something

for

this

sunburn.

Ref 5

I'd

pick

something

for

this

sunburn.

Output 0

want

cure

the

sunburn

valid

medicine.

N-grams

I	want	to	cure	the	sunburn	valid	medicine.
I		to

Output 1

want

sunburn

effective

the

medicine

N-grams

i	want	to	sunburn	effective	the	medicine	.
		to

Output 2

want

sunburn

and

effective

drug

administration.

N-grams

I	want	to	sunburn	and	effective	drug	administration.
I		to

Output 3

want

cure

the

sunburn

valid

medicine.

N-grams

I	want	to	cure	the	sunburn	valid	medicine.
I		to

Output 4

want

treat

the

sun-scald

effective

medicine.

N-grams

I	want	to	treat	the	sun-scald	effective	medicine.
I		to	treat
		to treat

Sentence 271) BLEU: 0 (1/1/1/0) ; 0 (0/0/0/0) ; 0 (1/1/1/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�C

Ref 0

I've

got

asthma.

Ref 1

suffer

from

asthma.

Ref 2

I've

got

asthma.

Ref 3

have

got

asthma.

Ref 4

have

asthma.

Ref 5

I've

got

asthma.

Output 0

have

asthma.

N-grams

I	have	asthma.
I	have	asthma.
I have
I have asthma.
	have asthma.

Output 1

asthma

N-grams

asthma

Output 2

have

asthma.

N-grams

I	have	asthma.
I	have	asthma.
I have
I have asthma.
	have asthma.

Output 3

asthma.

N-grams

My	asthma.
	asthma.

Output 4

asthma.

N-grams

My	asthma.
	asthma.

Sentence 272) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�u

�I

Ref 0

Come

here.

Ref 1

Come

here.

Ref 2

Come

here.

Ref 3

Come

over

here.

Ref 4

Come

here.

Ref 5

Come

here.

Output 0

Ah!

N-grams

Ah!

Output 1

N-grams

Output 2

哎哎!

N-grams

哎哎!

Output 3

ah!

N-grams

ah!

Output 4

ya!

N-grams

ya!

Sentence 273) BLEU: 1 (1/1/1/1) ; 0 (0.5/0.4/0.25/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.6667/0.4/0.25/0)

Source

��

�i�D

��

�z

��

�a�}

�C

Ref 0

Please

let

know

your

address.

Ref 1

Please

give

your

address.

Ref 2

May

have

your

address,

please?

Ref 3

Tell

your

address,

please.

Ref 4

Please

tell

your

address.

Ref 5

Give

your

address,

please.

Output 0

Please

tell

your

address.

N-grams

Please	tell	me	your	address.
Please	tell	me	your	address.
Please tell		me your
Please tell me			your address.
Please tell me your
	tell me
	tell me your
	tell me your address.
		me your address.

Output 1

please

tell

your

address

N-grams

please	tell	me	your	address	.
	tell	me	your
	tell me
	tell me your
		me your

Output 2

Please

tell

your

address.

N-grams

Please	tell	me	your	address.
Please	tell	me	your	address.
Please tell		me your
Please tell me			your address.
Please tell me your
	tell me
	tell me your
	tell me your address.
		me your address.

Output 3

Please

tell

your

address.

N-grams

Please	tell	me	your	address.
Please	tell	me	your	address.
Please tell		me your
Please tell me			your address.
Please tell me your
	tell me
	tell me your
	tell me your address.
		me your address.

Output 4

Please

tell

you

the

address.

N-grams

Please	tell	me	you	the	address.
Please	tell	me			address.
Please tell
Please tell me
	tell me

Sentence 274) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.25/0/0/0)

Source

�i�H

��

�y��

��

�H

Ref 0

Can

change

seat?

Ref 1

Could

change

seat?

Ref 2

would

change

seat,

please.

Ref 3

Could

switch

seats?

Ref 4

Can

change

seats?

Ref 5

Would

possible

change

seat?

Output 0

all

right

change

seat?

N-grams

Is	it	all	right	to	change	seat?
	it			to	change	seat?
				to change

Output 1

seat

N-grams

seat

Output 2

Can

exchange

seat?

N-grams

Can	exchange	seat?
Can		seat?

Output 3

all

right

change

seat?

N-grams

Is	it	all	right	to	change	seat?
	it			to	change	seat?
				to change

Output 4

May

trade

the

seat?

N-grams

May	trade	the	seat?
			seat?

Sentence 275) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.25/0/0/0)

Source

�u�r

�S

��

�F

�k

��u

�y

�C

Ref 0

Oh,

sliced

the

ball

again.

Ref 1

Oh,

sliced

the

ball

once

again.

Ref 2

Oh,

sliced

the

ball

again.

Ref 3

Oh,

sliced

the

ball

again.

Ref 4

Oh,

sliced

the

ball

again.

Ref 5

no,

sliced

the

ball

again.

Output 0

has

made

into

the

right

tune

armature.

N-grams

Oh	has	made	into	the	right	tune	armature.
Oh				the

Output 1

has

right

N-grams

has

right

Output 2

Oops

fight

has

become

right

curve

balls.

N-grams

Oops

fight

has

become

right

curve

balls.

Output 3

again

beat

right

screw

ball.

N-grams

Oh	again	beat	right	screw	ball.
Oh

Output 4

has

made

into

the

right

tune

armature.

N-grams

Oh	has	made	into	the	right	tune	armature.
Oh				the

Sentence 276) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5/0.2/0/0) ; 0 (0.2/0/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0.5081 (0.6667/0.6/0.5/0.3333)

Source

e�l

�O

��

�C

��

�@

��

�C

Ref 0

The

fork

dirty.
Please

change

it.

Ref 1

This

fork

dirty.
Would

you

please

change

it.

Ref 2

May

have

another

fork,

please?
This

one

dirty.

Ref 3

This

fork

isn't

clean.
Can

have

another

one,

please?.

Ref 4

The

fork

dirty.
Please

bring

another

one.

Ref 5

The

fork

dirty.
Please

bring

new

one.

Output 0

The

fork

dirty.

Please

Trade.

N-grams

The	fork	is	dirty.	Please	Trade.
The	fork	is	dirty.
The fork		is dirty.
The fork is
The fork is dirty.
	fork is
	fork is dirty.

Output 1

dirty

please

the

fork

N-grams

dirty	please	the	fork	is	.
	please		fork	is
			fork is

Output 2

Forks

are

dirty.

Please

for-1.

N-grams

Forks	are	dirty.	Please	for-1.
		dirty.

Output 3

The

fork

dirty.

Please

change

N-grams

The	fork	is	dirty.	Please	change	1.
The	fork	is	dirty.		change
The fork		is dirty.
The fork is
The fork is dirty.
	fork is
	fork is dirty.

Output 4

The

fork

dirty.

Please

trade.

N-grams

The	fork	is	dirty.	Please	trade.
The	fork	is	dirty.
The fork		is dirty.
The fork is
The fork is dirty.
	fork is
	fork is dirty.

Sentence 277) BLEU: 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�z

�L

�o

�r��

�C

Ref 0

Have

great

time.

Ref 1

Have

wonderful

time.

Ref 2

Have

fun.

Ref 3

Have

excellent

time.

Ref 4

Have

very

good

time.

Ref 5

Have

great

time.

Output 0

wish

you

pleasant

stay.

N-grams

I	wish	you	a	pleasant	stay.
			a

Output 1

wish

you

happily

N-grams

wish

you

happily

Output 2

wish

you

pleasant

stay.

N-grams

I	wish	you	a	pleasant	stay.
			a

Output 3

Wish

you

live

happily.

N-grams

Wish

you

live

happily.

Output 4

Wishes

you

cross

happily.

N-grams

Wishes

you

cross

happily.

Sentence 278) BLEU: 0 (0.2/0/0/0) ; 0 (0.1818/0/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0)

Source

�z

��

�O��

��

��I

��

�H

Ref 0

Could

you

keep

baggage

until

five

o'clock?

Ref 1

Would

you

hold

luggage

till

five

o'clock?

Ref 2

Can

leave

luggage

with

you

till

five

o'clock?

Ref 3

Could

you

hold

bags

until

five?

Ref 4

Could

you

hold

baggage

until

five

o'clock?

Ref 5

Could

you

keep

luggage

until

five

o'clock?

Output 0

You

can

help

the

baggage

Certainly

five

spots?

N-grams

You	can	help	me	the	baggage	Certainly	to	five	spots?
					baggage			five

Output 1

can

you

help

the

baggage

N-grams

can	you	help	me	to	5	:	00	the	baggage	?
	you								baggage

Output 2

Can

you

help

custody

their

luggage

5:00

it?

N-grams

Can	you	help	me	custody	of	their	luggage	to	5:00	it?
Can	you						luggage

Output 3

Can

you

maintain

the

baggage

5:00

for

me?

N-grams

Can	you	maintain	the	baggage	to	5:00	for	me?
Can	you			baggage

Output 4

You

can

help

the

baggage

certainly

five

spots?

N-grams

You	can	help	me	the	baggage	certainly	to	five	spots?
					baggage			five

Sentence 279) BLEU: 1 (1/1/1/1) ; 0 (0/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0)

Source

��

��ɶ�

�C

Ref 0

hurry.

Ref 1

I'm

rush.

Ref 2

rush.

Ref 3

don't

have

much

time.

Ref 4

I'm

hurry.

Ref 5

hurry.

Output 0

I'm

hurry.

N-grams

I'm	in	a	hurry.
I'm	in	a	hurry.
I'm in		a hurry.
I'm in a
I'm in a hurry.
	in a
	in a hurry.

Output 1

rush

time

N-grams

rush

time

Output 2

I'm

hurry.

N-grams

I'm	in	a	hurry.
I'm	in	a	hurry.
I'm in		a hurry.
I'm in a
I'm in a hurry.
	in a
	in a hurry.

Output 3

rush

time.

N-grams

I	rush	time.
I		time.

Output 4

rush

time.

N-grams

I	rush	to	time.
I			time.

Sentence 280) BLEU: 0 (0.5714/0.3333/0/0) ; 0 (0.7143/0.3333/0/0) ; 0 (0.5714/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6/0.3333/0.125/0)

Source

�٫�

��i

�~�y��

��

�F

�C

Ref 0

dropped

ring

into

the

washbasin.

Ref 1

dropped

ring

into

the

sink.

Ref 2

ring

fell

into

the

sink.

Ref 3

dropped

ring

into

the

washbasin.

Ref 4

ring

fell

into

the

washbasin.

Ref 5

dropped

ring

the

sink.

Output 0

Fall

into

the

washbasins

the

ring.

N-grams

Fall	into	the	washbasins	in	the	ring.
	into	the		in
	into the			in the

Output 1

into

the

ring

face

N-grams

into	the	in	the	ring	face	.
into	the	in		ring
into the		in the

Output 2

Fall

into

the

washbasins

the

ring.

N-grams

Fall	into	the	washbasins	in	the	ring.
	into	the		in
	into the			in the

Output 3

The

ring

drops

into

wash

face

pool

inside.

N-grams

The	ring	drops	into	wash	face	pool	inside.
	ring		into

Output 4

The

ring

fell

into

washes

the

face

the

pond.

N-grams

The	ring	fell	into	washes	the	face	in	the	pond.
	ring	fell	into		the		in
	ring fell						in the
	ring fell into
		fell into

Sentence 281) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�k

�C

Ref 0

have

pain.

Ref 1

pain.

Ref 2

I'm

pain.

Ref 3

have

pain.

Ref 4

have

pain.

Ref 5

have

pain.

Output 0

Pain.

N-grams

Pain.

Output 1

N-grams

Output 2

Pain.

N-grams

Pain.

Output 3

Painful.

N-grams

Painful.

Output 4

Sore.

N-grams

Sore.

Sentence 282) BLEU: 0 (1/0.75/0.6667/0) ; 0 (0.5/0.4/0.25/0) ; 0 (1/0.75/0.6667/0) ; 0 (1/0.75/0.6667/0) ; 0 (1/0.75/0.6667/0)

Source

��

�h

�o��

�a�}

�C

Ref 0

Take

this

address,

please.

Ref 1

Please

take

this

address.

Ref 2

Can

you

take

this

address,

please?

Ref 3

I'd

this

address,

please.

Ref 4

Take

this

address,

please.

Ref 5

Could

you

take

this

address,

please?

Output 0

Please

this

address.

N-grams

Please	go	to	this	address.
Please	go	to	this	address.
	go to		this address.
	go to this
		to this
		to this address.

Output 1

please

this

address

N-grams

please	go	to	this	address	.
	go	to	this
	go to
	go to this
		to this

Output 2

Please

this

address.

N-grams

Please	go	to	this	address.
Please	go	to	this	address.
	go to		this address.
	go to this
		to this
		to this address.

Output 3

Please

this

address.

N-grams

Please	go	to	this	address.
Please	go	to	this	address.
	go to		this address.
	go to this
		to this
		to this address.

Output 4

Please

this

address.

N-grams

Please	go	to	this	address.
Please	go	to	this	address.
	go to		this address.
	go to this
		to this
		to this address.

Sentence 283) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.125/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�Q

�n

�ѽL

�v��

�C��

�C

Ref 0

I'd

board

game.

Ref 1

would

play

board

game,

please.

Ref 2

would

board

game.

Ref 3

would

have

board

game.

Ref 4

I'd

board

game.

Ref 5

would

board

game,

please.

Output 0

I'd

board

games.

N-grams

I'd	like	board	games.
I'd	like	board
I'd like

Output 1

want

the

game

N-grams

want

the

game

Output 2

I'd

board

games.

N-grams

I'd	like	board	games.
I'd	like	board
I'd like

Output 3

want

the

game

the

chessboard

tournament.

N-grams

I	want	the	game	of	the	chessboard	tournament.
I

Output 4

want

the

checkerboard

athletics

game.

N-grams

I	want	the	checkerboard	athletics	game.
I					game.

Sentence 284) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

��n��

�C

Ref 0

It's

all

right.

Ref 1

It's

fine.

Ref 2

It's

all

okay.

Ref 3

It's

okay.

Ref 4

It's

all

right.

Ref 5

It's

all

right.

Output 0

Return

Never

mind.

N-grams

Return

Never

mind.

Output 1

N-grams

Output 2

Also

does

not

matter.

N-grams

Also

does

not

matter.

Output 3

Return

never

mind.

N-grams

Return

never

mind.

Output 4

Is	unimportant.

N-grams

Is	unimportant.

Sentence 285) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.6/0.5/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4/0.25/0/0)

Source

�~��H

�h

��

�H

Ref 0

Are

there

many

young

people?

Ref 1

Are

there

many

young

people?

Ref 2

Are

there

lot

young

persons?

Ref 3

Are

lot

young

people

there?

Ref 4

there

lot

young

people?

Ref 5

Are

there

lot

young

people?

Output 0

The

young

people

are

many?

N-grams

The	young	people	are	many?
	young	people
	young people

Output 1

many

young

people

the

N-grams

many	young	people	the	?
many	young	people
many young
	young people

Output 2

Many

young

people

do?

N-grams

Many	young	people	do?
	young	people
	young people

Output 3

the

young

man

many?

N-grams

Is	the	young	man	many?
Is		young

Output 4

The

young

people

are

many?

N-grams

The	young	people	are	many?
	young	people
	young people

Sentence 286) BLEU: 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.1667/0/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.4/0.1111/0/0) ; 0 (0.2857/0.1667/0/0)

Source

��

�b

��

�n��

��

�a��

�C

Ref 0

I'm

looking

for

some

interesting

places.

Ref 1

I'm

searching

for

some

interesting

sites.

Ref 2

I'm

looking

for

some

nice

places.

Ref 3

trying

find

few

interesting

places.

Ref 4

looking

for

some

interesting

places.

Ref 5

I'm

looking

for

some

places

interest.

Output 0

looking

for

fun

place.

N-grams

I	am	looking	for	a	fun	place.
I	am	looking	for	a
I am		looking for
I am looking
I am looking for
	am looking
	am looking for

Output 1

fun

place

finding

N-grams

i	am	fun	place	finding	.
	am

Output 2

looking

for

fun

place.

N-grams

I	am	looking	for	a	fun	place.
I	am	looking	for	a
I am		looking for
I am looking
I am looking for
	am looking
	am looking for

Output 3

finding

have

fun

much

place.

N-grams

I	am	finding	to	have	fun	so	much	of	place.
I	am		to					of
I am

Output 4

finding

the

place

which

plays.

N-grams

I	am	finding	the	place	which	plays.
I	am
I am

Sentence 287) BLEU: 0 (0.7143/0.5/0.4/0) ; 0 (0.4/0.25/0/0) ; 0 (0.5/0.2/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.7143/0.5/0.4/0)

Source

��

�e

�@

�i

�a��

��

�H

Ref 0

Could

you

draw

map?

Ref 1

Would

you

draw

map?

Ref 2

Could

you

draw

map

for

me?

Ref 3

Would

you

able

draw

map

for

me?

Ref 4

Could

you

sketch

map?

Ref 5

Can

you

draw

map?

Output 0

Can

give

draw

map?

N-grams

Can	give	me	to	draw	a	map?
Can			to	draw	a	map?
			to draw		a map?
			to draw a
				draw a
				draw a map?

Output 1

map

can

N-grams

a	map	can	me	?
a	map
a map

Output 2

Could

have

painted

map?

N-grams

Could	I	have	painted	a	map?
Could				a	map?
				a map?

Output 3

Can

make

uniform

map

for

me?

N-grams

Can	make	uniform	a	map	for	me?
Can			a	map	for	me?
			a map		for me?
			a map for
			a map for me?
				map for
				map for me?

Output 4

Can

give

draw

map?

N-grams

Can	give	me	to	draw	a	map?
Can			to	draw	a	map?
			to draw		a map?
			to draw a
				draw a
				draw a map?

Sentence 288) BLEU: 0 (0.4706/0.1875/0.06667/0) ; 0 (0.4615/0.08333/0/0) ; 0 (0.4706/0.1875/0.06667/0) ; 0 (0.3158/0/0/0) ; 0 (0.3158/0.05556/0/0)

Source

��

�C

�o��

��

�ӳ��

�C

��

��g

�o

�i

�d��

��

�X�f�B

��

�H��

�C

Ref 0

I'm

sorry.
Here

your

declaration

form.
Please

fill

out

the

card

and

give

the

attendant

the

exit.

Ref 1

apologies.
Here

your

declaration

form.
Please

fill

out

the

form

and

return

the

attendant

near

the

exit.

Ref 2

Sorry.
This

your

declaration

form.
Fill

out

the

card

and

give

the

attendant

the

way

out.

Ref 3

apologize.
Here's

your

declaration

form.
Please

fill

out

and

give

the

attendant

you

exit.

Ref 4

sorry.
Here

your

declaration

form.
Please

complete

the

card

and

give

the

attendant

the

exit.

Ref 5

apologize.
Here

your

declaration

form.
Please

fill

out

the

card

and

give

the

attendant

you

exit.

Output 0

sorry.

There

are

returns.

Please

fill

this

card

the

exit

the

staff.

N-grams

sorry.

There

are

returns.

Please

fill

this

card

the

exit

the

staff.

sorry.

fill

card

the

I am

to the

I am sorry.

am sorry.

Output 1

please

fill

this

card

the

exit

the

very

form

personnel

N-grams

please

fill

this

card

the

exit

the

very

form

personnel

fill

card

the

form

to the

Output 2

sorry.

There

are

returns.

Please

fill

this

card

the

exit

the

staff.

N-grams

sorry.

There

are

returns.

Please

fill

this

card

the

exit

the

staff.

sorry.

fill

card

the

I am

to the

I am sorry.

am sorry.

Output 3

Very

sorry.Here

have

already

declared

form.

Please

fill

this

card

give

exit

handle

affairs

personnel.

N-grams

Very

sorry.Here

have

already

declared

form.

Please

fill

this

card

give

exit

handle

affairs

personnel.

form.

fill

card

give

Output 4

Very

regrettable.

Here

has

Shanghai

report

form.

Please

fill

the

management

personnel

who

this

card

gives

the

exit.

N-grams

Very

regrettable.

Here

has

Shanghai

report

form.

Please

fill

the

management

personnel

who

this

card

gives

the

exit.

form.

fill

the

card

the

exit.

the exit.

Sentence 289) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�ӳ�

��~

�C

Ref 0

have

something

declare.

Ref 1

need

declare

something.

Ref 2

would

declare

something.

Ref 3

I've

got

something

declare.

Ref 4

have

something

declare.

Ref 5

have

goods

declare.

Output 0

Have

declare

goods.

N-grams

Have	to	declare	goods.
	to	declare
	to declare

Output 1

goods

N-grams

goods	.
goods

Output 2

Have

declare

goods.

N-grams

Have	to	declare	goods.
	to	declare
	to declare

Output 3

Declared

article.

N-grams

Declared

article.

Output 4

Has

the

declaration

goods.

N-grams

Has

the

declaration

goods.

Sentence 290) BLEU: 0 (0.5/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0)

Source

�{�b

�Ʊ�

�z

��U

��

�C

Ref 0

need

your

help

now.

Ref 1

require

your

help

now.

Ref 2

require

your

assistance

now.

Ref 3

I'm

need

your

help

now.

Ref 4

need

your

help

now.

Ref 5

need

you

help

now,

please.

Output 0

Now

hope

you

help

me.

N-grams

Now	I	hope	you	help	me.
	I		you	help

Output 1

now

hope

you

help

that

N-grams

now	hope	you	help	me	that	.
		you	help	me
			help me

Output 2

Now

hope

you

help

me.

N-grams

Now	I	hope	you	help	me.
	I		you	help

Output 3

Hope

now

that

you

help

me.

N-grams

Hope	now	that	you	help	me.
			you	help

Output 4

Now

hoped

that

you

help

me.

N-grams

Now	hoped	that	you	help	me.
			you	help

Sentence 291) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0)

Source

�z�n

�C

Ref 0

there.

Ref 1

there.

Ref 2

Hello

there.

Ref 3

there.

Ref 4

there.

Ref 5

Hello.

Output 0

How

you

do.

N-grams

How

you

do.

Output 1

hello

N-grams

hello

Output 2

Hello.

N-grams

Hello.

Output 3

How

you

do.

N-grams

How

you

do.

Output 4

Hello.

N-grams

Hello.

Sentence 292) BLEU: 0 (0.5556/0.25/0.1429/0) ; 0 (0.4286/0/0/0) ; 0 (0.5556/0.25/0.1429/0) ; 0 (0.375/0/0/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�s

��

�w�g

�w�q

�F

�C

Ref 0

have

reservation.
My

name

Nakamura.

Ref 1

have

reservation.
My

name

Nakamura.

Ref 2

have

booking.
I

Nakamura.

Ref 3

made

reservation

under

the

name

Nakamura.

Ref 4

have

reservation.
My

name's

Nakamura.

Ref 5

name

Nakamura

and

have

reservation.

Output 0

name

the

Village

have

been

booked.

N-grams

My	name	is	in	the	Village	have	been	booked.
My	name	is		the		have
My name
My name is
	name is

Output 1

name

the

village

have

already

N-grams

my	name	the	village	have	already	.
	name	the		have

Output 2

name

the

village

have

been

booked.

N-grams

My	name	is	in	the	village	have	been	booked.
My	name	is		the		have
My name
My name is
	name is

Output 3

call

medium

the

village

have

already

reserved.

N-grams

I	call	medium	the	village	have	already	reserved.
I			the		have

Output 4

name

was

Nakamura

already

order.

N-grams

My	name	was	Nakamura	already	to	order.
My	name		Nakamura
My name

Sentence 293) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�F

�C

Ref 0

All

right

ma'am.

Ref 1

Very

well

ma'am.

Ref 2

Okay

ma'am.

Ref 3

All

right

ma'am.

Ref 4

All

right

ma'am.

Ref 5

Certainly,

ma'am.

Output 0

Understand.

N-grams

Understand.

Output 1

understand

N-grams

understand

Output 2

Understand.

N-grams

Understand.

Output 3

Understand.

N-grams

Understand.

Output 4

Understood.

N-grams

Understood.

Sentence 294) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0)

Source

��

�e��

�L��

�C

Ref 0

have

allergies.

Ref 1

suffer

from

allergies.

Ref 2

have

allergies.

Ref 3

I've

got

allergies.

Ref 4

have

allergies.

Ref 5

have

allergies.

Output 0

easily

allergic.

N-grams

I	am	easily	allergic.
I

Output 1

easily

allergic

N-grams

easily

allergic

Output 2

easily

allergic.

N-grams

I	easily	allergic.
I

Output 3

easily

allergic.

N-grams

I	am	easily	allergic.
I

Output 4

easy

allergy.

N-grams

easy

allergy.

Sentence 295) BLEU: 0 (0.4/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�n

��

�N

�H

Ref 0

How

would

you

your

steak?

Ref 1

How

would

you

your

steak

cooked?

Ref 2

How

you

your

steak?

Ref 3

How

would

you

your

steak?

Ref 4

How

would

you

your

steak

done?

Ref 5

How

would

you

your

steak?

Output 0

How

does

the

steak

roast?

N-grams

How	does	the	steak	roast?
How			steak

Output 1

how

steak

the

roast

N-grams

how	steak	the	roast	?
	steak

Output 2

How

grilled

steak?

N-grams

How	grilled	steak?
How		steak?

Output 3

How

does

the

steak

roast?

N-grams

How	does	the	steak	roast?
How			steak

Output 4

How

can

the

beefsteak

roast?

N-grams

How	can	the	beefsteak	roast?
How

Sentence 296) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0/0/0)

Source

�o��

��

�A

�F

�C

Ref 0

This

too

flashy.

Ref 1

This

too

showy.

Ref 2

This

too

visible.

Ref 3

This

too

flashy.

Ref 4

This

too

flashy.

Ref 5

This

too

loud.

Output 0

This

too

gorgeous.

N-grams

This	is	too	gorgeous.
This	is	too
This is
This is too
	is too

Output 1

this

too

N-grams

this	too	.
	too

Output 2

Yan

had

this

too.

N-grams

Yan

had

this

too.

Output 3

This

too

gorgeous.

N-grams

This	is	too	gorgeous.
This	is	too
This is
This is too
	is too

Output 4

This

was

too

colorful.

N-grams

This	was	too	colorful.
This		too

Sentence 297) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.4/0.25/0/0)

Source

�A��

��

�n

��

�C

Ref 0

was

excellent

service.

Ref 1

The

service

was

excellent.

Ref 2

The

service

was

first-rate.

Ref 3

was

superb

service.

Ref 4

The

service

was

top

notch.

Ref 5

was

excellent

service.

Output 0

The

service

very

good.

N-grams

The	service	is	very	good.
The	service
The service

Output 1

service

very

good

N-grams

service	very	good	.
service

Output 2

Service

very

good

ah.

N-grams

Service

very

good

ah.

Output 3

Service

very

good.

N-grams

Service

very

good.

Output 4

The

service

very

good.

N-grams

The	service	is	very	good.
The	service
The service

Sentence 298) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0)

Source

�A

��

�@

��

�C

Ref 0

One

time,

please.

Ref 1

Another

time,

please.

Ref 2

One

time,

please.

Ref 3

Once

again,

please.

Ref 4

Once

more,

please.

Ref 5

Repeat

that

one

time,

please.

Output 0

Again.

N-grams

Again.

Output 1

again

N-grams

again

Output 2

Again.

N-grams

Again.

Output 3

Encore.

N-grams

Encore.

Output 4

Comes

one

time

again.

N-grams

Comes	one	time	again.
	one

Sentence 299) BLEU: 0 (0.5714/0.3333/0/0) ; 0 (0.375/0/0/0) ; 0 (0.5714/0.3333/0/0) ; 0 (0.4167/0.1818/0.1/0) ; 0 (0.4545/0.1/0/0)

Source

��

�}

��

��]

��

�j��

�C

Ref 0

Please

stop

the

main

entrance

the

hotel.

Ref 1

Please

stop

the

main

hotel

entrance.

Ref 2

Please

stop

the

main

door

the

hotel.

Ref 3

Please

stop

the

central

entrance

the

hotel.

Ref 4

Please

stop

the

hotel's

main

entrance.

Ref 5

Please

stop

the

main

entrance

the

hotel.

Output 0

Please

drive

the

hotel's

front

gate.

N-grams

Please	drive	to	the	hotel's	front	gate.
Please		to	the	hotel's
		to the
			the hotel's

Output 1

please

the

front

arrive

positive

door

the

N-grams

please	the	front	arrive	positive	door	the	.
	the				door	the

Output 2

Please

drive

the

hotel's

front

gate.

N-grams

Please	drive	to	the	hotel's	front	gate.
Please		to	the	hotel's
		to the
			the hotel's

Output 3

Please

arrive

the

positive

front

door

the

guest

house

car.

N-grams

Please	arrive	the	positive	front	door	of	the	guest	house	a	car.
Please		the			door	of	the
					door of
					door of the
						of the

Output 4

Please

arrive

the

vehicle

the

guesthouse

the

positive

front

door.

N-grams

Please	arrive	at	the	vehicle	the	guesthouse	the	positive	front	door.
Please		at	the		the
		at the

Sentence 300) BLEU: 0 (0.2222/0.125/0/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.2222/0.125/0/0) ; 0 (0.2222/0.125/0/0)

Source

��

�_

�ĤT

��

�ѥ]

�C

Ref 0

I'd

the

bread

which

third

from

the

left.

Ref 1

want

the

third

bread

from

the

left.

Ref 2

May

have

the

third

bread

from

the

left,

please?

Ref 3

would

the

loaf

bread

that

third

the

left.

Ref 4

I'd

the

bread

third

from

the

left.

Ref 5

I'd

that

bread

there,

third

from

the

left.

Output 0

Please

give

left

the

third

bread.

N-grams

Please	give	me	to	be	left	the	third	bread.
						the	third
						the third

Output 1

please

give

bread

third

left

the

N-grams

please	give	me	bread	third	left	to	the	.
			bread	third			the
			bread third

Output 2

Please

give

bread,

third

from

left.

N-grams

Please	give	me	bread,	third	from	left.
				third	from	left.
				third from

Output 3

Please

give

left

rise

the

third

bread.

N-grams

Please	give	me	left	to	rise	the	third	bread.
						the	third
						the third

Output 4

Please

give

left

the

third

bread.

N-grams

Please	give	me	to	be	left	the	third	bread.
						the	third
						the third

Sentence 301) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�Dñ�W

��

�H

Ref 0

Have

you

signed

them?

Ref 1

Have

you

signed

them?

Ref 2

Did

you

sign

them?

Ref 3

Have

you

signed

them?

Ref 4

Have

you

signed

them?

Ref 5

Have

you

signed

them?

Output 0

there

main

signature?

N-grams

there

main

signature?

Output 1

the

main

signature

N-grams

the

main

signature

Output 2

The

main

signatures

have

it?

N-grams

The

main

signatures

have

it?

Output 3

there

main

signature?

N-grams

there

main

signature?

Output 4

Has

the

main

signature?

N-grams

Has

the

main

signature?

Sentence 302) BLEU: 0 (0.5714/0.3333/0.2/0) ; 0 (0.4286/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.5/0.2222/0.125/0) ; 0 (0.5714/0.3333/0.2/0)

Source

�Q

��

�q��

�C

Ref 0

need

find

pay

phone.

Ref 1

need

locate

public

telephone.

Ref 2

require

pay

phone.

Ref 3

need

locate

pay

phone.

Ref 4

need

pay

phone.

Ref 5

need

find

public

phone.

Output 0

Wants

look

for

public

telephone.

N-grams

Wants	to	look	for	a	public	telephone.
	to			a	public	telephone.
				a public
				a public telephone.
					public telephone.

Output 1

for

department

public

telephone

N-grams

for	department	public	to	a	telephone	.
		public	to	a

Output 2

Looking

for

the

Department

public

telephones.

N-grams

Looking	for	the	Department	of	public	telephones.
					public

Output 3

Want

find

department

Mr.

used

telephone.

N-grams

Want	to	find	a	department	Mr.	is	used	a	telephone.
	to	find	a						telephone.
	to find
	to find a
		find a

Output 4

Wants

look

for

public

telephone.

N-grams

Wants	to	look	for	a	public	telephone.
	to			a	public	telephone.
				a public
				a public telephone.
					public telephone.

Sentence 303) BLEU: 0 (0.1111/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.1111/0/0/0) ; 0 (0.2222/0/0/0)

Source

��

�@�U

��n

��q��

�C

Ref 0

Hold

the

line,

please.

Ref 1

Please

hold.

Ref 2

Can

you

hold

the

line,

please?

Ref 3

Please

hold

on.

Ref 4

Hold

on,

please.

Ref 5

Please,

hold

the

line.

Output 0

Please

wait

for

second

don't

hang

telephone.

N-grams

Please	wait	for	a	second	don't	hang	a	telephone.
Please

Output 1

please

wait

not

hang

telephone

N-grams

please

wait

not

hang

telephone

Output 2

Please

Wait

not

hang

phone.

N-grams

Please	Wait	Do	not	hang	up	phone.
Please

Output 3

Please

wait

for

second

don't

hang

telephone.

N-grams

Please	wait	for	a	second	don't	hang	a	telephone.
Please

Output 4

Please

wait

not

make

the

telephone

call

suddenly.

N-grams

Please	wait	not	to	make	the	telephone	call	suddenly.
Please					the

Sentence 304) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.25/0/0/0)

Source

��

�h

�C

Ref 0

I'd

happy

come.

Ref 1

would

delighted

come.

Ref 2

I'd

delighted

attend.

Ref 3

would

happy

come.

Ref 4

I'd

happy

come.

Ref 5

I'd

glad

come.

Output 0

very

happy

go.

N-grams

I	am	very	happy	to	go.
I			happy	to
			happy to

Output 1

very

happy

N-grams

i	am	to	go	very	happy	.
		to			happy

Output 2

glad

go.

N-grams

I	am	glad	to	go.
I		glad	to
		glad to

Output 3

very

happy

go.

N-grams

I	am	very	happy	to	go.
I			happy	to
			happy to

Output 4

very

happy.

N-grams

I	am	very	happy.
I

Sentence 305) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�G

��

�C

Ref 0

have

heartburn.

Ref 1

have

heartburn.

Ref 2

I've

got

heartburn.

Ref 3

have

indigestion.

Ref 4

have

heartburn.

Ref 5

have

heartburn.

Output 0

suffered

stomach.

N-grams

suffered

stomach.

Output 1

stomach

uncomfortable

N-grams

stomach

uncomfortable

Output 2

Stomach

uncomfortable.

N-grams

Stomach

uncomfortable.

Output 3

suffered

stomach.

N-grams

suffered

stomach.

Output 4

stomach

uncomfortable.

N-grams

stomach

uncomfortable.

Sentence 306) BLEU: 0 (0.3333/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4444/0/0/0) ; 0 (0.3333/0/0/0)

Source

�o��

�{

�㦳

�N��

��

�O

��

�H

Ref 0

What

kind

doll

typical

for

this

State?

Ref 1

Which

type

doll

representative

for

this

State?

Ref 2

Which

doll

type

characteristic

for

this

state?

Ref 3

What

sort

doll

would

typical

this

State?

Ref 4

What

kind

doll

typical

for

this

State?

Ref 5

What

sort

doll

typical

this

State?

Output 0

What

does

this

state

have

the

representative

baby

is?

N-grams

What	does	this	state	have	the	representative	baby	is?
What		this				representative

Output 1

the

state

representative

what

this

N-grams

the	state	representative	what	is	this	?
		representative		is	this

Output 2

The

state

representative

dolls

are

what?

N-grams

The	state	representative	dolls	are	what?
		representative

Output 3

What

this

state's

hasing

the

representative's

doll

N-grams

What	is	this	state's	hasing	the	representative's	doll	?
What	is	this					doll

Output 4

What

does

this

state

have

the

representative

baby

is?

N-grams

What	does	this	state	have	the	representative	baby	is?
What		this				representative

Sentence 307) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6/0.25/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6667/0.4/0.25/0) ; 0 (0/0/0/0)

Source

��

�a�K��

�b

��

�H

Ref 0

Where

the

nearest

subway

station?

Ref 1

Where

the

closest

metro

station?

Ref 2

Can

you

indicate

the

nearest

subway

station?

Ref 3

Where

the

closest

subway

station?

Ref 4

Where's

the

closest

subway

station?

Ref 5

Where

the

nearest

subway

station?

Output 0

Where

the

nearest

subway?

N-grams

Where	is	the	nearest	subway?
Where	is	the	nearest
Where is		the nearest
Where is the
Where is the nearest
	is the
	is the nearest

Output 1

where

the

subway

N-grams

where	is	the	subway	?
	is	the	subway
	is the

Output 2

Where

the

nearest

subway?

N-grams

Where	is	the	nearest	subway?
Where	is	the	nearest
Where is		the nearest
Where is the
Where is the nearest
	is the
	is the nearest

Output 3

Where

the

recent

subway

stood?

N-grams

Where	is	the	recent	subway	stood?
Where	is	the		subway
Where is
Where is the
	is the

Output 4

Recently

underground

station

where?

N-grams

Recently

underground

station

where?

Sentence 308) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.8333/0.6/0.25/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.8/0.5/0/0)

Source

�O

��

�C

Ref 0

Don't

keep

waiting.

Ref 1

Please

not

make

wait.

Ref 2

Don't

let

wait

for

you.

Ref 3

Don't

make

wait

long.

Ref 4

Don't

late.

Ref 5

Don't

make

wait

for

you.

Output 0

Don't

keep

waiting

for.

N-grams

Don't	keep	me	waiting	for.
Don't	keep	me
Don't keep
Don't keep me
	keep me

Output 1

not

let

wait

N-grams

do	not	let	me	wait	.
do	not	let	me	wait
do not		let me
		let me wait
			me wait

Output 2

not

let

wait

ah.

N-grams

Do	not	let	me	wait	ah.
	not	let	me	wait
		let me
		let me wait
			me wait

Output 3

Don't

keep

waiting

for.

N-grams

Don't	keep	me	waiting	for.
Don't	keep	me
Don't keep
Don't keep me
	keep me

Output 4

not

let

wait.

N-grams

Do	not	let	me	wait.
	not	let	me	wait.
		let me
			me wait.

Sentence 309) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�ΪA

�C

Ref 0

feel

sick.

Ref 1

don't

feel

well.

Ref 2

I'm

not

feeling

well.

Ref 3

feel

ill.

Ref 4

feel

sick.

Ref 5

feel

unwell.

Output 0

Not	comfortable.

N-grams

Not	comfortable.

Output 1

uncomfortable

N-grams

uncomfortable

Output 2

Uncomfortable.

N-grams

Uncomfortable.

Output 3

Not	comfortable.

N-grams

Not	comfortable.

Output 4

Is	uncomfortable.

N-grams

Is	uncomfortable.

Sentence 310) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.5714/0.1667/0/0)

Source

�h

�c��

��

�n

�O

�H

Ref 0

How

can

get

the

palace?

Ref 1

How

can

get

the

palace?

Ref 2

Where

the

palace?

Ref 3

Which

way

the

palace?

Ref 4

How

get

the

palace?

Ref 5

How

can

get

the

palace?

Output 0

How

goes

the

palace

walk?

N-grams

How	goes	to	the	palace	to	walk?
How		to	the
		to the

Output 1

how

the

palace

walk

N-grams

how	go	to	the	palace	walk	?
		to	the
		to the

Output 2

Palaces

how

well

go?

N-grams

Palaces	how	well	it	go?
			it

Output 3

how

the

palace

walk

like?

N-grams

Go	to	how	the	palace	walk	like?
	to		the

Output 4

How

goes

the

palace

walk?

N-grams

How	goes	to	the	palace	to	walk?
How		to	the
		to the

Sentence 311) BLEU: 0 (0.375/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.3333/0/0/0)

Source

�L

�
��

�A

�Y��

�i�H

��

�H

Ref 0

May

have

meal

later?

Ref 1

Can

have

meal

later

time?

Ref 2

Can

eat

dinner

later?

Ref 3

Could

eat

meal

later?

Ref 4

May

eat

later?

Ref 5

Would

possible

for

have

meal

later?

Output 0

Moment

and

then

had

eat

possible?

N-grams

Moment	and	then	had	to	eat	it	possible?
				to	eat	it

Output 1

eat

again

meal

N-grams

to	eat	again	meal	?
to	eat		meal

Output 2

Moment

and

then

had

eat

possible?

N-grams

Moment	and	then	had	to	eat	it	possible?
				to	eat	it

Output 3

Lead

meeting

son

again

have

meal

can?

N-grams

Lead	meeting	son	again	have	a	meal	can?
				have	a	meal

Output 4

Crosses

the

little

while

eat

meal

again

may?

N-grams

Crosses	the	little	while	to	eat	meal	again	may?
				to	eat	meal

Sentence 312) BLEU: 0 (0.625/0.2857/0.1667/0) ; 0 (0.5/0.2/0/0) ; 0 (0.625/0.2857/0.1667/0) ; 0 (0.4545/0.2/0.1111/0) ; 0 (0.25/0.09091/0/0)

Source

�R

�T

��

�K�y

�I��

��

�H

Ref 0

Can

you

give

discount

buy

three

them?

Ref 1

Would

you

give

discount

bought

three?

Ref 2

Would

get

price

reduction

take

three

them?

Ref 3

buy

three

them,

will

get

discount?

Ref 4

there

discount

buy

three

them?

Ref 5

buy

three

them,

can

you

give

discount?

Output 0

Buy

three

you

give

something

cheaper?

N-grams

Buy	three	if	you	give	me	something	cheaper?
	three	if	you	give	me
			you give
			you give me
				give me

Output 1

three

give

words

cheap

N-grams

three	give	me	words	cheap	?
three	give	me
	give me

Output 2

Buy

three

you

give

something

cheaper?

N-grams

Buy	three	if	you	give	me	something	cheaper?
	three	if	you	give	me
			you give
			you give me
				give me

Output 3

Can

buying

three

words

give

little

bit

cheap

son?

N-grams

Can	buying	three	words	give	me	a	little	bit	cheap	son?
Can		three		give	me	a
				give me
				give me a
					me a

Output 4

Buys

three

words

able

give

the

cheap

spot?

N-grams

Buys	three	words	to	be	able	to	give	me	the	cheap	spot?
	three						give	me
							give me

Sentence 313) BLEU: 0 (0.4286/0.1667/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.2857/0/0/0)

Source

�Q

�A

��

�@

��

�C

Ref 0

would

stay

one

night.

Ref 1

want

stay

one

night.

Ref 2

would

remain

extra

night.

Ref 3

I'd

stay

another

night.

Ref 4

would

stay

one

night.

Ref 5

would

stay

one

additional

night.

Output 0

Want

stay

again

for

night.

N-grams

Want	to	stay	again	for	a	night.
	to	stay				night.
	to stay

Output 1

night

again

for

N-grams

night	to	again	for	.
	to

Output 2

night.

N-grams

Like	night.
	night.

Output 3

Want

stay

again

for

night.

N-grams

Want	to	stay	again	for	a	night.
	to	stay				night.
	to stay

Output 4

Wants

live

again

for

one

evening.

N-grams

Wants	to	live	again	for	one	evening.
	to				one

Sentence 314) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.6/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.2/0/0/0)

Source

��

�M�u�x

��

�H

Ref 0

there

mosque

nearby?

Ref 1

there

mosque

the

neighborhood?

Ref 2

Would

there

mosque

near

here?

Ref 3

there

mosque

here?

Ref 4

there

mosque

by?

Ref 5

there

mosque

the

vicinity?

Output 0

There

mosque

neighborhood?

N-grams

There	is	mosque	in	neighborhood?
		mosque	in	neighborhood?
		mosque in

Output 1

the

mosque

has

N-grams

the	the	mosque	has	?
the		mosque

Output 2

The

vicinity

the

mosque

has

it?

N-grams

The	vicinity	of	the	mosque	has	it?
			the	mosque

Output 3

There

mosque

neighborhood?

N-grams

There	is	mosque	in	neighborhood?
		mosque	in	neighborhood?
		mosque in

Output 4

The

nearby

has

the

mosque?

N-grams

The	nearby	has	the	mosque?
			the

Sentence 315) BLEU: 0 (0.2222/0.05882/0/0) ; 0 (0.07692/0/0/0) ; 0 (0.3077/0/0/0) ; 0 (0.2222/0.05882/0/0) ; 0 (0.1667/0/0/0)

Source

�@��

��

�ӻ�

��

�a�B

�C

Ref 0

Personally,

wouldn't

say

that.

Ref 1

opinion,

wouldn't

say

that.

Ref 2

wouldn't

say

that

myself.

Ref 3

you

ask

me,

would

not

say

that.

Ref 4

Personally,

would

not

say

that.

Ref 5

No,

wouldn't

say

that

personally.

Output 0

say

that

can't

make

reference

that

kind

the

words

situation.

N-grams

say

that

can't

make

reference

that

kind

the

words

situation.

say

that

say that

Output 1

can

speak

that

kind

the

words

situation

N-grams

can

speak

that

kind

the

words

situation

that

Output 2

far

concerned

can

not

speak

that

point.

N-grams

far

concerned

can

not

speak

that

point.

not

that

Output 3

say

that

can't

make

reference

that

kind

the

words

situation.

N-grams

say

that

can't

make

reference

that

kind

the

words

situation.

say

that

say that

Output 4

Cannot

speak

the

words

that

kind

situation.

N-grams

Cannot	speak	of	as	my	me	the	words	that	kind	of	situation.
				my				that

Sentence 316) BLEU: 0 (0.2727/0.09524/0/0) ; 0 (0.125/0/0/0) ; 0 (0.2727/0.09524/0/0) ; 0 (0.2/0.05263/0/0) ; 0 (0.375/0.2/0.07143/0)

Source

�^��Ť��q

�C

�q

�o��

�@��

��

�^��

��

�d�i

�᭱

�C

��W

�N

��

��D

�C

Ref 0

British

Airways.
Walk

straight

ahead,

then

behind

the

British

Airways

counters.
You

can't

miss

it.

Ref 1

British

Airways.
Just

walk

straight,

then

behind

the

counters

British

Airways.
You

will

see

it.

Ref 2

British

Airways.
Go

straight,

then

turn

behind

the

desks.
You

can't

miss

it.

Ref 3

British

Airways.
Walk

straight

ahead,

and

you'll

find

the

British

Airways

counter.
You

can't

miss

it.

Ref 4

British

Airways.
Walk

straight

ahead,

then

behind

the

British

Airways

counters.
You

cannot

miss

it.

Ref 5

British

Airways.
Go

straight

ahead

and

then

behind

the

British

Airways

counters.
You

can't

miss

it.

Output 0

British

Airways.

From

here,

walk

around

the

United

Kingdom

has

been

behind

the

counter

aviation.

Will

able

know

immediately.

N-grams

British

Airways.

From

here,

walk

around

the

United

Kingdom

has

been

behind

the

counter

aviation.

Will

able

know

immediately.

British

Airways.

walk

the

behind

British Airways.

behind the

Output 1

british

airways

from

here

the

has

been

behind

counter

aviation

know

immediately

british

can

N-grams

british

airways

from

here

the

has

been

behind

counter

aviation

know

immediately

british

can

the

behind

Output 2

British

Airways.

From

here,

walk

around

the

United

Kingdom

has

been

behind

the

counter

aviation.

Will

able

know

immediately.

N-grams

British

Airways.

From

here,

walk

around

the

United

Kingdom

has

been

behind

the

counter

aviation.

Will

able

know

immediately.

British

Airways.

walk

the

behind

British Airways.

behind the

Output 3

British

airline.

Have

been

walking

round

back

the

counter

British

aviation

from

here.

Can

know

right

away.

N-grams

British

airline.

Have

been

walking

round

back

the

counter

British

aviation

from

here.

Can

know

right

away.

British

the

British

of British

Output 4

British

Airways.

Has

walked

from

here

circles

behind

the

British

Airway

counter.

Can

know

immediately.

N-grams

British

Airways.

Has

walked

from

here

circles

behind

the

British

Airway

counter.

Can

know

immediately.

British

Airways.

behind

the

British

counter.

British Airways.

behind the

behind the British

the British

Sentence 317) BLEU: 0 (0.25/0.1429/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.25/0.1429/0/0)

Source

�O

��w

�٬O

�Y��

�H

Ref 0

injection

orally?

Ref 1

needle

mouth?

Ref 2

injection

orally?

Ref 3

Intravenously

mouth?

Ref 4

injection

mouth?

Ref 5

injection

orally?

Output 0

gives

injection

takes

drug?

N-grams

Is	gives	an	injection	or	takes	a	drug?
			injection	or
			injection or

Output 1

take

medicine

N-grams

or	take	medicine	a	?
or

Output 2

Are

injections

take

medicine?

N-grams

Are	injections	or	take	medicine?
		or

Output 3

give

shot

take

medicine?

N-grams

BE	give	a	shot	or	take	medicine?
				or

Output 4

gives

injection

takes

drug?

N-grams

Is	gives	an	injection	or	takes	a	drug?
			injection	or
			injection or

Sentence 318) BLEU: 0 (0.6667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�Q

�n

�Q

�C

Ref 0

I'd

some

salt.

Ref 1

would

have

some

salt.

Ref 2

May

have

some

salt?

Ref 3

I'd

some

salt.

Ref 4

would

some

salt.

Ref 5

I'd

some

salt.

Output 0

want

salt.

N-grams

I	want	salt.
I		salt.

Output 1

want

salt

N-grams

want

salt

Output 2

want

salt.

N-grams

I	want	salt.
I		salt.

Output 3

want

salt.

N-grams

I	want	salt.
I		salt.

Output 4

want

the

salt.

N-grams

I	want	the	salt.
I			salt.

Sentence 319) BLEU: 0 (0.6/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0/0/0/0)

Source

�X�I

�n��

�H

Ref 0

When

boarding

time?

Ref 1

When

the

time

for

boarding?

Ref 2

what

time

board?

Ref 3

What

the

boarding

time?

Ref 4

When

boarding

time?

Ref 5

What

time

board?

Output 0

What

time

get

board?

N-grams

What	time	get	on	board?
What	time			board?
What time

Output 1

N-grams

Output 2

Some

boarding?

N-grams

Some	boarding?
	boarding?

Output 3

What

time

get

board?

N-grams

What	time	get	on	board?
What	time			board?
What time

Output 4

How

many

boardings?

N-grams

How

many

boardings?

Sentence 320) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0)

Source

��

�b

�o��

ñ�W

�C

Ref 0

Sign

here.

Ref 1

Put

your

signature

here.

Ref 2

Sign

here.

Ref 3

Sign

here.

Ref 4

Sign

here.

Ref 5

Sign

right

here.

Output 0

Please

sign

here.

N-grams

Please	sign	here.
		here.

Output 1

please

sign

here

N-grams

please

sign

here

Output 2

Please

sign

here.

N-grams

Please	sign	here.
		here.

Output 3

Please

sign

here.

N-grams

Please	sign	here.
		here.

Output 4

Please

here

signature.

N-grams

Please

here

signature.

Sentence 321) BLEU: 0 (0.75/0.4286/0.1667/0) ; 0 (0/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.625/0.4286/0.1667/0)

Source

�O

�ƺ��y�s��

�

��

�ж�

�C

Ref 0

Hilton

Hotel,

room

four

five

six.

Ref 1

Hilton

Hotel,

room

four

five

six.

Ref 2

Hotel

Hilton,

room

four

five

six.

Ref 3

Hilton

Hotel,

room

four

hundred

fifty

six.

Ref 4

Hilton

Hotel,

room

four

fifty

six.

Ref 5

Room

four

five

six

the

Hilton

Hotel.

Output 0

the

Hilton

Hotel

four

five

six

rooms.

N-grams

Is	the	Hilton	Hotel	four	five	six	rooms.
	the	Hilton	Hotel	four	five	six
	the Hilton			four five
				four five six
					five six

Output 1

hilton

hotel

456

rooms

N-grams

hilton

hotel

456

rooms

Output 2

Hilton

Hotel

are

456

rooms.

N-grams

Hilton	Hotel	are	456	rooms.
Hilton	Hotel

Output 3

Being

Hilton

cabaret

456

rooms.

N-grams

Being	Hilton	cabaret	is	456	rooms.
	Hilton

Output 4

the

Hilton

hotel

four

five

six

rooms.

N-grams

Is	the	Hilton	hotel	four	five	six	rooms.
	the	Hilton		four	five	six
	the Hilton			four five
				four five six
					five six

Sentence 322) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.5/0.2/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.4/0/0/0) ; 0 (0.2/0/0/0)

Source

�z

��

�}�G�s

�H

Ref 0

Can

you

recommend

any

your

aperitifs

for

me,

please?

Ref 1

Could

you

suggest

any

your

aperitifs

me,

please?

Ref 2

Can

you

recommend

one

your

aperitifs,

please?

Ref 3

Could

you

suggest

any

your

aperitifs,

please?

Ref 4

Could

you

recommend

aperitif

for

me,

please?

Ref 5

Can

you

recommend

any

your

cocktails

for

me,

please?

Output 0

What

you

recommend

aperitif?

N-grams

What	you	recommend	an	aperitif?
	you	recommend	an
	you recommend
	you recommend an
		recommend an

Output 1

what

you

recommend

aperitif

N-grams

what	you	recommend	aperitif	do	?
	you	recommend	aperitif
	you recommend

Output 2

What

you

recommend

aperitif?

N-grams

What	you	recommend	an	aperitif?
	you	recommend	an
	you recommend
	you recommend an
		recommend an

Output 3

What

aperitif

you

recommend?

N-grams

What	aperitif	do	you	recommend?
	aperitif		you

Output 4

What

apetirif

you

recommend?

N-grams

What	apetirif	do	you	recommend?
			you

Sentence 323) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�i�f�i��

�C

Ref 0

Coke,

please.

Ref 1

Please,

coke.

Ref 2

coke,

please.

Ref 3

Coke,

please.

Ref 4

Coke,

please.

Ref 5

I'll

take

Coke,

please.

Output 0

Please

give

coca-cola.

N-grams

Please	give	me	a	coca-cola.
			a

Output 1

please

give

coca-cola

the

N-grams

please

give

coca-cola

the

Output 2

Please

give

Coca-Cola.

N-grams

Please	give	me	a	Coca-Cola.
			a

Output 3

Please

give

the

Coca-Cola.

N-grams

Please

give

the

Coca-Cola.

Output 4

Please

give

the

Coca-Cola.

N-grams

Please

give

the

Coca-Cola.

Sentence 324) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0)

Source

��

�b

��

�H

Ref 0

Mr.

Takahashi

there,

please?

Ref 1

Please,

Mr.

Takahashi

there?

Ref 2

Mr.

Takahashi

there,

please?

Ref 3

Mr.

Takahashi

available,

please?

Ref 4

Mr.

Takahashi

there,

please?

Ref 5

Mr.

Takahashi

there?

Output 0

Mr.

gao

qiao

in?

N-grams

Mr.	gao	qiao	in?
Mr.

Output 1

mr.

gao

N-grams

mr.

gao

Output 2

Mr.

Gao

Qiao

in?

N-grams

Mr.	Gao	Qiao	in?
Mr.

Output 3

Mr.

Gao

Qiao2

at?

N-grams

Mr.	Gao	Qiao2	at?
Mr.

Output 4

Gaoqiao

gentleman

in?

N-grams

Gaoqiao

gentleman

in?

Sentence 325) BLEU: 0 (0.4667/0.1429/0/0) ; 0 (0.4545/0.2/0/0) ; 0 (0.4667/0.1429/0/0) ; 0 (0.381/0/0/0) ; 0 (0.5/0.1333/0/0)

Source

�o��

��Z

�

�y�L

��I

�@�
��

�C

��L

�Ҧ�

��

�S

��D

�C

Ref 0

This

flight

has

been

delayed

little.
But

all

connecting

flights

can

made.

Ref 1

This

flight

has

been

delayed

bit.
But

all

the

connecting

flights

can

still

made.

Ref 2

This

flight

was

slightly

delayed.
However,

all

connecting

flights

are

still

available.

Ref 3

This

flight

has

been

slightly

delayed,

but

there

won't

problem

making

all

connections.

Ref 4

This

flight

has

been

delayed

bit.
But

can

make

all

connecting

flights.

Ref 5

This

flight

has

been

slightly

delayed.
But

you

will

able

make

all

connecting

flights.

Output 0

The

flights

will

delayed

little

while.

But

not

all

the

transit

problem.

N-grams

The

flights

will

delayed

little

while.

But

not

all

the

transit

problem.

flights

will

delayed

all

the

will be

delayed a

Output 1

the

will

little

while

not

all

this

late

N-grams

the	will	be	a	little	while	not	all	this	late	.
the	will	be	a				all
	will be
		be a

Output 2

The

flights

will

delayed

little

while.

But

not

all

the

transit

problem.

N-grams

The

flights

will

delayed

little

while.

But

not

all

the

transit

problem.

flights

will

delayed

all

the

will be

delayed a

Output 3

This

service

will

little

bit

and

late

order

short

while.However

all

become

all

right

the

ground.

N-grams

This

service

will

little

bit

and

late

order

short

while.However

all

become

all

right

the

ground.

This

will

all

the

Output 4

This

flight

will

late

slightly

while.

However

all

relays

not

have

the

question.

N-grams

This

flight

will

late

slightly

while.

However

all

relays

not

have

the

question.

This

flight

will

slightly

all

the

This flight

will be

Sentence 326) BLEU: 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.375/0.2857/0.1667/0) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.3333/0.2/0/0) ; 0.3457 (0.5/0.4286/0.3333/0.2)

Source

��

�b

��

�p��

�M�d

�C

Ref 0

I'm

looking

for

fiction.

Ref 1

searching

for

fiction.

Ref 2

I'm

searching

for

some

fiction.

Ref 3

I'm

trying

find

fiction.

Ref 4

looking

for

fiction.

Ref 5

I'm

looking

for

fiction.

Output 0

looking

for

novel

counter.

N-grams

I	am	looking	for	a	novel	counter.
I	am	looking	for
I am		looking for
I am looking
I am looking for
	am looking
	am looking for

Output 1

looking

for

novel

counter

N-grams

i	am	looking	for	a	novel	counter	.
	am	looking	for
	am looking
	am looking for
		looking for

Output 2

looking

for

novel

counter.

N-grams

I	am	looking	for	a	novel	counter.
I	am	looking	for
I am		looking for
I am looking
I am looking for
	am looking
	am looking for

Output 3

finding

novel

counter.

N-grams

I	am	finding	a	novel	counter.
I	am
I am

Output 4

looking

for

the

novel

special

counter.

N-grams

I	am	looking	for	the	novel	special	counter.
I	am	looking	for
I am		looking for
I am looking
I am looking for
	am looking
	am looking for

Sentence 327) BLEU: 0 (0.6667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0/0/0/0)

Source

��

�U��

��

�ȹC

��

�H

Ref 0

you

have

any

afternoon

tours?

Ref 1

Are

there

any

tours

the

afternoon?

Ref 2

you

tours

the

afternoons?

Ref 3

Are

there

any

tours

for

this

afternoon?

Ref 4

you

have

tours

the

afternoon?

Ref 5

you

have

any

afternoon

tours

that

run

the

afternoon?

Output 0

there

the

tour

afternoon?

N-grams

Is	there	the	tour	in	afternoon?
	there	the		in	afternoon?

Output 1

afternoon

tour

has

N-grams

afternoon	tour	has	?
afternoon

Output 2

Afternoon

tour

has

it?

N-grams

Afternoon

tour

has

it?

Output 3

there

the

tour

afternoon?

N-grams

Is	there	the	tour	in	afternoon?
	there	the		in	afternoon?

Output 4

Has

afternoon's

traveling?

N-grams

Has

afternoon's

traveling?

Sentence 328) BLEU: 0 (0.2308/0/0/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.4/0/0/0) ; 0 (0.2308/0/0/0) ; 0 (0.375/0.1429/0/0)

Source

�o

��T

��

��Ĵ�

�O

��

�ɭ�

�H

Ref 0

What's

the

expiration

date

for

this

cheese?

Ref 1

When

does

this

cheese

expire?

Ref 2

What

the

expiry

date

for

this

cheese?

Ref 3

When

the

expiration

date

for

this

cheese?

Ref 4

What

the

expiration

date

for

this

cheese?

Ref 5

What's

the

expiration

date

this

cheese?

Output 0

The

term

validity

this

cream

cheese

when?

N-grams

The

term

validity

this

cream

cheese

when?

this

cheese

Output 1

this

cheese

when

term

validity

N-grams

this	cheese	is	when	term	of	validity	to	?
this	cheese	is
this cheese

Output 2

This

cheese

valid

when?

N-grams

This	cheese	is	valid	when?
	cheese	is

Output 3

The

term

validity

this

cream

cheese

when?

N-grams

The

term

validity

this

cream

cheese

when?

this

cheese

Output 4

When

this

cheese's

term

validity

to?

N-grams

When	is	this	cheese's	term	of	validity	to?
When	is	this
When is

Sentence 329) BLEU: 0 (0.2857/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.4444/0.125/0/0) ; 0 (0.2857/0/0/0)

Source

�O

�@

��

�x�

��L

��R

��

�a��

�C

Ref 0

It's

famous

for

the

beautiful

gardens

temples.

Ref 1

famous

for

the

beautiful

gardens

the

temples.

Ref 2

renowned

for

the

marvelous

gardens

its

temples.

Ref 3

well-known

for

the

lovely

temple

gardens.

Ref 4

famous

for

the

beautiful

temple

gardens.

Ref 5

It's

well-known

for

its

beautiful

gardens

temples.

Output 0

temple

botanical

garden

beautiful

place.

N-grams

Is	a	temple	botanical	garden	beautiful	place.
		temple			beautiful

Output 1

temple

garden

place

beauty

N-grams

temple	garden	is	a	place	of	beauty	.
temple		is			of

Output 2

Temple

garden

place

beauty.

N-grams

Temple	garden	is	a	place	of	beauty.
		is			of

Output 3

the

place

monastery

park

beauty.

N-grams

It	is	the	place	of	a	monastery	park	beauty.
It	is	the		of
It is

Output 4

temple

botanical

garden

beautiful

place.

N-grams

Is	a	temple	botanical	garden	beautiful	place.
		temple			beautiful

Sentence 330) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2857/0/0/0)

Source

�i�H

��

�ײz

��

�H

��

�H

Ref 0

Would

you

send

someone

repair

it?

Ref 1

Would

you

ask

someone

fix

it?

Ref 2

Could

you

send

somebody

put

right?

Ref 3

Could

you

send

someone

fix

it?

Ref 4

Will

you

send

someone

fix

it?

Ref 5

Would

you

send

someone

fix

it?

Output 0

all

right

send

person

who

fixs

come?

N-grams

Is	it	all	right	to	send	a	person	who	fixs	to	come?
	it			to	send

Output 1

send

repair

person

come

N-grams

send	a	repair	person	come	?
send		repair

Output 2

Can

send

repair

person

come?

N-grams

Can	send	a	repair	person	come?
	send		repair

Output 3

all

right

send

person

who

fixs

come?

N-grams

Is	it	all	right	to	send	a	person	who	fixs	to	come?
	it			to	send

Output 4

May

send

repair

the

human

comes?

N-grams

May	send	a	repair	the	human	comes?
	send		repair

Sentence 331) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5/0/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0.5081 (0.6667/0.6/0.5/0.3333)

Source

��

�b

�饻

��

�S��

��

�C

Ref 0

They

don't

sell

this

Japan,

yet.

Ref 1

This

isn't

sold

Japan,

yet.

Ref 2

yet

this

not

sold

Japan.

Ref 3

You

can't

buy

this

Japan,

yet.

Ref 4

This

not

for

sale

Japan,

yet.

Ref 5

This

not

yet

for

sale

Japan..

Output 0

That

has

not

sold

Japan.

N-grams

That	has	not	sold	in	Japan.
		not	sold	in	Japan.
		not sold		in Japan.
		not sold in
		not sold in Japan.
			sold in
			sold in Japan.

Output 1

that

not

japan

sold

N-grams

that	not	in	japan	sold	.
	not	in		sold

Output 2

That

did

not

sell

Japan.

N-grams

That	did	not	sell	in	Japan.
		not	sell	in	Japan.
				in Japan.

Output 3

That

hasn't

sold

Japan.

N-grams

That	hasn't	sold	in	Japan.
		sold	in	Japan.
		sold in
		sold in Japan.
			in Japan.

Output 4

That

has

not

sold

Japan.

N-grams

That	has	not	sold	in	Japan.
		not	sold	in	Japan.
		not sold		in Japan.
		not sold in
		not sold in Japan.
			sold in
			sold in Japan.

Sentence 332) BLEU: 0 (0.5/0.2857/0/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.5/0.4/0/0) ; 0 (0.5/0.2857/0/0) ; 0 (0.1667/0/0/0)

Source

�g�H

�ݰ�

�o

��

��w

�a

�C

Ref 0

I'll

write

her

inquire

after

her

safety.

Ref 1

will

write

her

see

about

her

safety.

Ref 2

will

write

her

and

ask

her

she

safe.

Ref 3

I'll

write

her

and

ask

she

safe.

Ref 4

will

write

her

ask

after

her

safety.

Ref 5

I'll

write

her

ask

she

safe.

Output 0

Writing

letter

ask

her

peaceful.

N-grams

Writing	a	letter	to	ask	her	is	peaceful.
			to	ask	her	is
			to ask
				ask her

Output 1

her

ask

letter

N-grams

her	to	ask	a	letter	.
her	to	ask
her to
her to ask
	to ask

Output 2

Her

Ping'an

write

ask

you.

N-grams

Her	Ping'an	write	to	ask	you.
		write	to	ask
		write to
			to ask

Output 3

Writing

letter

ask

her

peaceful.

N-grams

Writing	a	letter	to	ask	her	is	peaceful.
			to	ask	her	is
			to ask
				ask her

Output 4

Writes

letter

asks

her

safely.

N-grams

Writes	a	letter	asks	her	safely.
				her

Sentence 333) BLEU: 0 (0.1818/0/0/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.125/0/0/0) ; 0 (0.1818/0/0/0)

Source

��

�M

�ѱ�

�z

�n

��

�@

��

�H

Ref 0

Would

you

chicken

pasta?

Ref 1

Would

you

prefer

chicken

pasta?

Ref 2

you

prefer

chicken

pasta?

Ref 3

you

want

chicken

pasta?

Ref 4

Would

you

pasta

chicken?

Ref 5

What

would

you

like:

chicken

pasta?

Output 0

Which

one

kind

the

chicken

and

the

noodles

you

want?

N-grams

Which	one	kind	the	chicken	and	the	noodles	do	you	want?
				chicken					you

Output 1

chicken

and

noodles

which

you

want

kind

N-grams

chicken	and	noodles	which	you	want	kind	do	?
chicken				you	want
				you want

Output 2

Chicken

and

noodles

which

you

want

to?

N-grams

Chicken	and	noodles	which	you	want	to?
				you	want
				you want

Output 3

Chicken

and

noodles

which

kind

you

want?

N-grams

Chicken	and	noodles	which	kind	do	you	want?
						you

Output 4

Which

one

kind

the

chicken

and

the

noodles

you

want?

N-grams

Which	one	kind	the	chicken	and	the	noodles	do	you	want?
				chicken					you

Sentence 334) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.2/0/0/0) ; 0.8091 (0.8571/0.8333/0.8/0.75) ; 0 (0.25/0/0/0)

Source

��ۻ�B

�b

��

�H

Ref 0

Where's

the

lost

and

found?

Ref 1

Where

the

lost

and

found?

Ref 2

Where

the

lost

and

found

department?

Ref 3

Where's

the

lost

and

found?

Ref 4

Where's

the

lost

and

found?

Ref 5

Where's

the

lost

and

found

office?

Output 0

Where

the

lost

and

found?

N-grams

Where	is	the	lost	and	found?
Where	is	the	lost	and	found?
Where is		the lost		and found?
Where is the			lost and
Where is the lost
	is the		lost and found?
	is the lost
	is the lost and
		the lost and
		the lost and found?

Output 1

lost

and

found

where

N-grams

lost	and	found	where	?
lost	and	found
lost and
lost and found
	and found

Output 2

Lost

and

Found

where?

N-grams

Lost	and	Found	in	where?
	and

Output 3

Where

the

lost

and

found

N-grams

Where	is	the	lost	and	found	?
Where	is	the	lost	and	found
Where is		the lost		and found
Where is the			lost and
Where is the lost
	is the		lost and found
	is the lost
	is the lost and
		the lost and
		the lost and found

Output 4

Where

does

lost-and-found

occupy?

N-grams

Where	does	lost-and-found	occupy?
Where

Sentence 335) BLEU: 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�Q

�n

�ȩ�

�e�\

�A��

�C

Ref 0

May

have

room

service?

Ref 1

Could

order

room

service?

Ref 2

Can

have

room

service,

please?

Ref 3

Can

order

room

service?

Ref 4

Could

have

room

service?

Ref 5

Room

service,

please.

Output 0

want

room

service.

N-grams

I	want	room	service.
I		room

Output 1

want

room

service

guest

meal

N-grams

i	want	room	service	guest	to	meal	.
i		room

Output 2

want

room

service.

N-grams

I	want	room	service.
I		room

Output 3

want

guest

room

send

meal

service.

N-grams

I	want	guest	room	to	send	a	meal	service.
I			room

Output 4

want

the

guest

room

deliver

meal

the

service.

N-grams

I	want	the	guest	room	to	deliver	meal	the	service.
I				room

Sentence 336) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0)

Source

j��

��

�ɭ�

�^��

�H

Ref 0

When

will

back?

Ref 1

When

will

return?

Ref 2

When

does

return?

Ref 3

When

will

back?

Ref 4

When

will

back?

Ref 5

When

will

back?

Output 0

When

did

you

probably

come

back?

N-grams

When	did	you	probably	come	back?
When					back?

Output 1

come

back

when

probably

N-grams

come

back

when

probably

Output 2

Perhaps

come

back?

N-grams

Perhaps	come	back?
		back?

Output 3

When

did

you

probably

come

back?

N-grams

When	did	you	probably	come	back?
When					back?

Output 4

When

probably

comes

back?

N-grams

When	probably	comes	back?
When			back?

Sentence 337) BLEU: 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.3333/0/0/0)

Source

�o

��

�a

�F

�C

Ref 0

There

something

wrong

with

this

car.

Ref 1

There

something

not

right

with

this

car.

Ref 2

This

car

has

got

something

wrong

with

it.

Ref 3

There

problem

with

this

car.

Ref 4

There's

something

the

matter

with

this

car.

Ref 5

There

something

wrong

with

this

car.

Output 0

The

car

broken.

N-grams

The	car	is	broken.
	car	is

Output 1

car

this

N-grams

car	this	.
car	this

Output 2

The

car

broken.

N-grams

The	car	is	broken.
	car	is

Output 3

This

car

broke

down.

N-grams

This	car	broke	down.
This	car
This car

Output 4

This

Che

Huai.

N-grams

This	Che	Huai.
This

Sentence 338) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.125/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3/0/0/0)

Source

��

�Q

�n

�ȩ�

�e�\

�A��

�C

Ref 0

Room

service,

please.

Ref 1

Please,

room

service.

Ref 2

May

have

room

service,

please.

Ref 3

I'd

room

service,

please.

Ref 4

Room

service,

please.

Ref 5

Room

service,

please.

Output 0

want

room

service.

N-grams

I	want	room	service.
I		room	service.
		room service.

Output 1

want

room

service

guest

meal

N-grams

i	want	room	service	guest	to	meal	.
		room

Output 2

want

room

service.

N-grams

I	want	room	service.
I		room	service.
		room service.

Output 3

want

guest

room

send

meal

service.

N-grams

I	want	guest	room	to	send	a	meal	service.
I			room					service.

Output 4

want

the

guest

room

deliver

meal

the

service.

N-grams

I	want	the	guest	room	to	deliver	meal	the	service.
I				room					service.

Sentence 339) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0)

Source

@�_

�Y

�߶�

�a

�C

Ref 0

Would

you

have

dinner

with

us?

Ref 1

Would

you

have

dinner

with

us?

Ref 2

Would

you

dine

with

us?

Ref 3

you

want

grab

some

dinner

with

us?

Ref 4

Would

you

join

for

dinner?

Ref 5

Would

you

care

join

for

dinner?

Output 0

Dinner

with

you.

N-grams

Dinner	with	you.
	with

Output 1

dinner

together

N-grams

dinner	together	.
dinner

Output 2

Dinner

with

you.

N-grams

Dinner	with	you.
	with

Output 3

Have

supper

together.

N-grams

Have

supper

together.

Output 4

Has

the

dinner

together.

N-grams

Has	the	dinner	together.
		dinner

Sentence 340) BLEU: 0.3156 (0.5556/0.375/0.2857/0.1667) ; 0 (0.2857/0/0/0) ; 0 (0/0/0/0) ; 0.2778 (0.5/0.3333/0.25/0.1429) ; 0 (0.1/0/0/0)

Source

@��

��

�O

�h��

�H

Ref 0

How

much

the

fare

for

first

class

seat?

Ref 1

What

the

fare

for

seat

first

class?

Ref 2

How

much

does

first

class

seat

costs?

Ref 3

How

much

first

class

seat?

Ref 4

How

much

does

cost

for

first

class

seat?

Ref 5

What's

the

fare

for

first

class

seat?

Output 0

How

much

the

price

etc.

ticket?

N-grams

How	much	is	a	the	price	of	etc.	ticket?
How	much	is	a	the
How much		is a
How much is
How much is a
	much is
	much is a

Output 1

ticket

prices

are

how

much

the

N-grams

ticket	prices	are	how	much	the	?
				much	the

Output 2

First-class

ticket

prices

are

how

much?

N-grams

First-class

ticket

prices

are

how

much?

Output 3

How

much

the

price

etc.

ticket

N-grams

How	much	is	a	the	price	of	etc.	ticket	?
How	much	is	a	the
How much		is a
How much is
How much is a
	much is
	much is a

Output 4

One

and

how

many

are

the

ticket

prices?

N-grams

One	and	so	on	how	many	are	the	ticket	prices?
							the

Sentence 341) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�H

Ref 0

What

kind

you

have?

Ref 1

What

kinds

you

have?

Ref 2

What

type

you

have?

Ref 3

What

kind

you

have?

Ref 4

What

kind

you

have?

Ref 5

What

kind

you

have?

Output 0

What

are

the

types?

N-grams

What	are	the	types?
What

Output 1

types

which

N-grams

types

which

Output 2

What

are

the

types?

N-grams

What	are	the	types?
What

Output 3

Which

categories?

N-grams

Which

categories?

Output 4

Which

types

has?

N-grams

Which

types

has?

Sentence 342) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

��軫�]

�C

Ref 0

The

Chelsea

Hotel,

please.

Ref 1

The

Chelsea

Hotel,

please.

Ref 2

Hotel

Chelsea,

please.

Ref 3

The

Chelsea

Hotel,

please.

Ref 4

The

Chelsea

Hotel,

please.

Ref 5

Chelsea

Hotel,

please.

Output 0

徹西

Hotel.

N-grams

徹西

Hotel.

Output 1

west

N-grams

west

Output 2

Go	to徹西Hotel.

N-grams

Go	to徹西Hotel.

Output 3

Please

Che

west

guest

house.

N-grams

Please

Che

west

guest

house.

Output 4

Welcome

penetrating

west

guesthouse.

N-grams

Welcome

penetrating

west

guesthouse.

Sentence 343) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0)

Source

�b

��

�O

�H

Ref 0

Where

can

catch

the

bus?

Ref 1

Where

can

get

bus?

Ref 2

Where

the

nearest

bus

stop?

Ref 3

Where

can

get

the

bus?

Ref 4

Where

can

catch

the

bus?

Ref 5

Where

catch

the

bus?

Output 0

Where

sitting?

N-grams

Where	is	it	sitting?
Where	is
Where is

Output 1

where

N-grams

where

Output 2

Where

sitting?

N-grams

Where	is	it	sitting?
Where	is
Where is

Output 3

Where

did

you

sit

N-grams

Where	did	you	sit	it	?
Where

Output 4

Sits

where?

N-grams

Sits

where?

Sentence 344) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0)

Source

�u

�O

��

�n

�Ѯ�

�C

Ref 0

Good

flying

weather.

Ref 1

Good

weather

for

flying.

Ref 2

Excellent

weather

for

flying.

Ref 3

Nice

weather

fly

in.

Ref 4

Good

flying

weather.

Ref 5

Good

flying

weather.

Output 0

really

flying

good

weather.

N-grams

It	is	really	flying	good	weather.
			flying		weather.

Output 1

flying

really

good

weather

N-grams

flying	is	really	good	weather	.
flying				weather

Output 2

Flying

really

good

weather.

N-grams

Flying	is	really	good	weather.
				weather.

Output 3

really

flying

good

weather.

N-grams

It	is	really	flying	good	weather.
			flying		weather.

Output 4

Really

flight

fine

weather.

N-grams

Really	flight	fine	weather.
			weather.

Sentence 345) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�n

��

�O

��

�C

Ref 0

Take

advice.

Ref 1

Listen

advice.

Ref 2

Please

counsel.

Ref 3

You

should

listen

advice.

Ref 4

Take

recommendation.

Ref 5

You

should

take

advice.

Output 0

Not

the

good

matter

will

not

say.

N-grams

Not

the

good

matter

will

not

say.

Output 1

will

not

say

good

matter

not

N-grams

will

not

say

good

matter

not

Output 2

Bad

thing

because

will

not

say.

N-grams

Bad

thing

because

will

not

say.

Output 3

Not

good

matter

will

not

say.

N-grams

Not

good

matter

will

not

say.

Output 4

Not

the

good

matter

will

not

say.

N-grams

Not

the

good

matter

will

not

say.

Sentence 346) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�ɭ�

�}�l

��

�H

Ref 0

Since

when?

Ref 1

From

when?

Ref 2

when?

Ref 3

How

long?

Ref 4

Since

when?

Ref 5

Since

when?

Output 0

When

did

you

start?

N-grams

When

did

you

start?

Output 1

when

N-grams

when

Output 2

When

started?

N-grams

When

started?

Output 3

When

did

you

start?

N-grams

When

did

you

start?

Output 4

When

starts?

N-grams

When

starts?

Sentence 347) BLEU: 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0)

Source

��

�Q

�n

�T��

�y��

�C

Ref 0

non-smoking

seat,

please.

Ref 1

seat

the

non-smoking

section,

please.

Ref 2

One

seat,

non-smoking,

please.

Ref 3

I'd

non-smoking

seat,

please.

Ref 4

non-smoking

seat,

please.

Ref 5

non-smoking

seat,

please.

Output 0

want

non-smoking

seats.

N-grams

I	want	non-smoking	seats.
		non-smoking

Output 1

want

seat

N-grams

i	want	to	seat	.
			seat

Output 2

want

non-smoking

seats.

N-grams

I	want	non-smoking	seats.
		non-smoking

Output 3

want

forbid

smoke

seat.

N-grams

want

forbid

smoke

seat.

Output 4

want

ban

smoking

the

seat.

N-grams

I	want	to	ban	smoking	the	seat.
					the

Sentence 348) BLEU: 0 (0.375/0.2857/0.1667/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.375/0.2857/0.1667/0) ; 0 (0.1429/0/0/0)

Source

��

�M��

��

�@��

�C

Ref 0

cup

coffee,

please.

Ref 1

cup

coffee,

please.

Ref 2

coffee,

please.

Ref 3

Some

coffee,

please.

Ref 4

One

cup

coffee,

please.

Ref 5

I'd

cup

coffee,

please.

Output 0

Please

take

cup

coffee

for

packing.

N-grams

Please	take	a	cup	of	coffee	for	packing.
		a	cup	of
		a cup
		a cup of
			cup of

Output 1

please

take

the

coffee

cup

N-grams

please	take	the	coffee	cup	.
				cup

Output 2

Please

take

the

coffee

cup.

N-grams

Please

take

the

coffee

cup.

Output 3

Please

take

cup

coffee

for

packing.

N-grams

Please	take	a	cup	of	coffee	for	packing.
		a	cup	of
		a cup
		a cup of
			cup of

Output 4

Please

take

the

cup

attire

the

coffee.

N-grams

Please	take	the	cup	attire	the	coffee.
			cup

Sentence 349) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0/0/0/0) ; 0 (0.75/0.6667/0.5/0)

Source

�Q

�q

�᭱

��

�F

�C

Ref 0

was

rear-ended.

Ref 1

car

was

hit

from

behind.

Ref 2

was

hit

the

back.

Ref 3

was

hit

from

behind.

Ref 4

car

was

rear-ended.

Ref 5

Someone

rear-ended

me.

Output 0

Was

hit

from

behind.

N-grams

Was	hit	from	behind.
	hit	from	behind.
	hit from
	hit from behind.
		from behind.

Output 1

hit

from

behind

N-grams

hit	from	behind	.
hit	from
hit from

Output 2

Was

hit

from

behind.

N-grams

Was	hit	from	behind.
	hit	from	behind.
	hit from
	hit from behind.
		from behind.

Output 3

From

behind

bumped.

N-grams

From

behind

bumped.

Output 4

hit

from

behind.

N-grams

Is	hit	from	behind.
	hit	from	behind.
	hit from
	hit from behind.
		from behind.

Sentence 350) BLEU: 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�N

�n

�C

Ref 0

need

them

tomorrow.

Ref 1

need

them

tomorrow.

Ref 2

They

will

required

tomorrow.

Ref 3

must

have

them

tomorrow.

Ref 4

need

them

for

tomorrow.

Ref 5

require

them

tomorrow.

Output 0

Tomorrow.

N-grams

Tomorrow.

Output 1

tomorrow

will

N-grams

tomorrow	will	.
	will

Output 2

Tomorrow.

N-grams

Tomorrow.

Output 3

Tomorrow

will.

N-grams

Tomorrow

will.

Output 4

Will

want

tomorrow.

N-grams

Will	want	tomorrow.
		tomorrow.

Sentence 351) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.6/0.5/0.3333/0) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.6/0.5/0.3333/0)

Source

�ȹC

�ت�

�O

��

�H

Ref 0

What's

the

purpose

your

visit?

Ref 1

What

the

reason

for

your

visit?

Ref 2

What

are

the

reasons

for

your

stay?

Ref 3

What's

the

purpose

your

visit?

Ref 4

What

the

purpose

your

visit?

Ref 5

What's

the

reason

for

your

visit?

Output 0

What

the

tour

purpose?

N-grams

What	is	the	tour	purpose?
What	is	the
What is
What is the
	is the

Output 1

what

the

purpose

N-grams

what	is	the	purpose	?
	is	the	purpose
	is the
	is the purpose
		the purpose

Output 2

What

the

purpose

tourism?

N-grams

What	is	the	purpose	of	tourism?
What	is	the	purpose	of
What is		the purpose
What is the			purpose of
What is the purpose
	is the
	is the purpose
	is the purpose of
		the purpose of

Output 3

What

the

tour

purpose

N-grams

What	is	the	tour	purpose	?
What	is	the		purpose
What is
What is the
	is the

Output 4

What

the

traveling

goal?

N-grams

What	is	the	traveling	goal?
What	is	the
What is
What is the
	is the

Sentence 352) BLEU: 0.224 (0.6875/0.3333/0.1429/0.07692) ; 0 (0.75/0.1818/0/0) ; 0.224 (0.6875/0.3333/0.1429/0.07692) ; 0.1861 (0.6111/0.2353/0.125/0.06667) ; 0 (0.3846/0.1667/0.09091/0)

Source

��

�Q

�w�q

�U�g��

�Q

��

�M

�Q

��

��H��

�C

Ref 0

want

reserve

double

for

weekend,

the

fifteenth

and

the

sixteenth.

Ref 1

would

make

reservation

for

double

weekend,

the

fifteenth

and

the

sixteenth.

Ref 2

would

book

double

room

for

weekend,

the

fifteenth

and

the

sixteenth.

Ref 3

would

reserve

double

room

for

weekend,

the

fifteenth

and

the

sixteenth.

Ref 4

I'd

reserve

double

for

weekend,

the

fifteenth

and

the

sixteenth.

Ref 5

I'd

reserve

double

for

weekend,

that

will

the

fifteenth

and

the

sixteenth.

Output 0

I'd

reserve

weekend

the

15th

and

the

double

room

the

16th.

N-grams

I'd

reserve

weekend

the

15th

and

the

double

room

the

16th.

I'd

reserve

the

and

the

double

room

I'd like

to reserve

and the

double room

I'd like to

I'd like to reserve

like to

like to reserve

Output 1

reserve

weekend

the

and

the

double

the

want

N-grams

i	to	reserve	next	weekend	the	and	the	double	the	want	.
	to	reserve	next		the	and	the	double		want
	to reserve					and the

Output 2

I'd

reserve

weekend

the

15th

and

the

double

room

the

16th.

N-grams

I'd

reserve

weekend

the

15th

and

the

double

room

the

16th.

I'd

reserve

the

and

the

double

room

I'd like

to reserve

and the

double room

I'd like to

I'd like to reserve

like to

like to reserve

Output 3

want

reserve

the

weekend

the

double

numbers

and

the

16ths

the

human

life.

N-grams

want

reserve

the

weekend

the

double

numbers

and

the

16ths

the

human

life.

want

reserve

the

double

and

I want

to reserve

and the

I want to

I want to reserve

want to

want to reserve

Output 4

want

order

weekend

ten

five

and

ten

six

two

person.

N-grams

want

order

weekend

ten

five

and

ten

six

two

person.

want

and

I want

I want to

want to

Sentence 353) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4286/0.3333/0.2/0) ; 0 (0.4/0.25/0/0)

Source

��

�Q

�n

��H

�ж�

�C

Ref 0

I'd

twin

room,

please.

Ref 1

want

twin

room,

please.

Ref 2

I'd

twin

room,

please.

Ref 3

I'd

twin

room,

please.

Ref 4

would

twin

room,

please.

Ref 5

I'd

book

twin

room,

please.

Output 0

want

double

room.

N-grams

I	want	to	double	room.
I	want	to
I want

Output 1

want

double

room

N-grams

i	want	double	room	.
	want

Output 2

want

double

room.

N-grams

I	want	to	double	room.
I	want	to
I want

Output 3

want

pair

person's

rooms.

N-grams

I	want	a	pair	of	person's	rooms.
I	want	a
I want
I want a
	want a

Output 4

want

the

double

room.

N-grams

I	want	the	double	room.
I	want
I want

Sentence 354) BLEU: 0 (0.8333/0.2/0/0) ; 0 (0.8/0.25/0/0) ; 0 (0.5/0/0/0) ; 0 (0.8333/0.2/0/0) ; 0 (0.75/0.6667/0/0)

Source

��

�h

��

�C

Ref 0

I'll

there

rental

car.

Ref 1

will

travel

there

rental

car.

Ref 2

I'll

drive

rental

car

there.

Ref 3

I'll

rent

car

get

there.

Ref 4

I'll

get

there

rental

car.

Ref 5

I'll

there

rental

car.

Output 0

Rent

car

there.

N-grams

Rent	a	car	go	to	there.
	a	car	go	to	there.
	a car

Output 1

car

there

N-grams

car	go	there	a	.
car	go	there	a
	go there

Output 2

Car

Rental

there.

N-grams

Car	Rental	go	there.
		go	there.

Output 3

Rent

car

there.

N-grams

Rent	a	car	go	to	there.
	a	car	go	to	there.
	a car

Output 4

Rents

car

there.

N-grams

Rents	a	car	there.
	a	car	there.
	a car
		car there.

Sentence 355) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.6667/0.2/0/0)

Source

�@��

��

�S��

�W��

�C

Ref 0

coffee

hasn't

come

yet.

Ref 1

coffee

still

has

not

arrived.

Ref 2

coffee

hasn't

arrived

yet.

Ref 3

haven't

gotten

coffee

yet.

Ref 4

coffee

still

hasn't

come.

Ref 5

coffee

hasn't

come

yet.

Output 0

Coffee

hasn't

come

up.

N-grams

Coffee	hasn't	come	up.
	hasn't	come
	hasn't come

Output 1

coffee

has

not

come

N-grams

coffee	has	not	up	come	.
coffee	has	not		come
	has not

Output 2

Coffee

has

not

yet

up.

N-grams

Coffee	has	not	yet	up.
	has	not
	has not

Output 3

Coffee

hasn't

come

up.

N-grams

Coffee	hasn't	come	up.
	hasn't	come
	hasn't come

Output 4

The

coffee

has

not

come

up.

N-grams

The	coffee	has	not	come	up.
	coffee	has	not	come
		has not

Sentence 356) BLEU: 1 (1/1/1/1) ; 0 (0.4/0.25/0/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (1/0.5/0/0)

Source

��

�q

�饻

��

�C

Ref 0

I'm

from

Japan.

Ref 1

come

from

Japan.

Ref 2

I'm

from

Japan.

Ref 3

I'm

from

Japan.

Ref 4

from

Japan.

Ref 5

I'm

from

Japan.

Output 0

come

from

Japan.

N-grams

I	come	from	Japan.
I	come	from	Japan.
I come		from Japan.
I come from
I come from Japan.
	come from
	come from Japan.

Output 1

come

from

japan

N-grams

i	come	from	japan	.
	come	from
	come from

Output 2

come

from

Japan.

N-grams

I	come	from	Japan.
I	come	from	Japan.
I come		from Japan.
I come from
I come from Japan.
	come from
	come from Japan.

Output 3

come

from

Japan.

N-grams

I	come	from	Japan.
I	come	from	Japan.
I come		from Japan.
I come from
I come from Japan.
	come from
	come from Japan.

Output 4

from

Japan.

N-grams

I	from	Japan.
I	from	Japan.
	from Japan.

Sentence 357) BLEU: 0 (0.1111/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1111/0/0/0)

Source

�O

��

�S��

��

�F��

�C

Ref 0

No,

there

was

such

thing

left

behind.

Ref 1

No,

there

was

nothing

left

behind.

Ref 2

No,

nothing

that

was

left

behind.

Ref 3

No,

there

was

such

thing

left

behind.

Ref 4

No,

there

wasn't

any

such

thing

left

behind.

Ref 5

No,

there

was

such

thing

left

behind.

Output 0

not

does

not

have

such

thing.

N-grams

It	is	not	I	does	not	have	such	thing.
							such

Output 1

not

thing

N-grams

i	not	thing	.
		thing

Output 2

not

rather

than

things.

N-grams

I	do	not	like	rather	than	things.
			like

Output 3

not

didn't

thing.

N-grams

not

didn't

thing.

Output 4

not

does

not

have

such

thing.

N-grams

It	is	not	I	does	not	have	such	thing.
							such

Sentence 358) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�n��

�C

Ref 0

All

right,

sir.

Ref 1

Very

well,

sir.

Ref 2

Yes,

sir.

Ref 3

Okay,

sir.

Ref 4

All

right,

sir.

Ref 5

All

right,

sir.

Output 0

Okay.

N-grams

Okay.

Output 1

N-grams

Output 2

好的.

N-grams

好的.

Output 3

Okay.

N-grams

Okay.

Output 4

Good.

N-grams

Good.

Sentence 359) BLEU: 0 (0.8462/0.4167/0.1818/0) ; 0 (0.6667/0.2727/0.1/0) ; 0 (0.6/0.2143/0.07692/0) ; 0 (0.8462/0.4167/0.1818/0) ; 0 (0.3333/0.09091/0/0)

Source

��

�C

��

�U

��

��B

�C

�Ʊ�

�z

��

�ѥ[

�B§

�C

Ref 0

Thank

you

very

much.
I'm

getting

married

month.
I

hope

you

will

able

come

wedding.

Ref 1

Thanks

very

much.
Next

month,

will

get

married.
I

would

very

much

you

were

able

come

wedding.

Ref 2

Thanks

lot.
Next

month

I'm

getting

hitched.
I

hope

you'll

manage

attend

wedding.

Ref 3

Thanks

lot.
I'll

getting

married

month.
I

hope

you

can

come

wedding.

Ref 4

Thank

you

very

much.
I

getting

married

month.
I

hope

you'll

able

attend

wedding.

Ref 5

Thank

you

very

much.
I'm

getting

married

month

and

hope

you

will

able

attend

wedding.

Output 0

Thank.

will

get

married

month.

Hope

you

attend

wedding.

N-grams

Thank.

will

get

married

month.

Hope

you

attend

wedding.

will

get

married

month.

you

attend

wedding.

I will

married next

to attend

I will get

married next month.

will get

next month.

Output 1

get

married

month

hope

you

the

wedding

attend

N-grams

i	get	married	next	month	hope	you	to	the	wedding	attend	.
	get	married	next	month	hope	you	to			attend
		married next			hope you
		married next month
			next month

Output 2

謝謝.

get

married

month.

hope

you

take

part

the

wedding.

N-grams

謝謝.

get

married

month.

hope

you

take

part

the

wedding.

get

married

month.

hope

you

wedding.

married next

hope you

married next month.

next month.

Output 3

Thank.

will

get

married

month.

Hope

you

attend

wedding.

N-grams

Thank.

will

get

married

month.

Hope

you

attend

wedding.

will

get

married

month.

you

attend

wedding.

I will

married next

to attend

I will get

married next month.

will get

next month.

Output 4

Thanks.

month

marriage.

Hoped

that

you

attend

the

wedding

ceremony.

N-grams

Thanks.	My	next	month	marriage.	Hoped	that	you	attend	the	wedding	ceremony.
		next	month				you	attend
		next month

Sentence 360) BLEU: 0 (1/1/1/0) ; 0 (0.5/0.3333/0/0) ; 0 (1/1/1/0) ; 0 (1/1/1/0) ; 0 (1/1/1/0)

Source

��

�C

Ref 0

Help

me,

please.

Ref 1

Please

assist

me.

Ref 2

Help

me,

please.

Ref 3

Please

help

me.

Ref 4

Help

me,

please.

Ref 5

Can

you

please

help

me?

Output 0

Please

help

me.

N-grams

Please	help	me.
Please	help	me.
Please help
Please help me.
	help me.

Output 1

please

help

N-grams

please	help	me	.
please	help
please help

Output 2

Please

help

me.

N-grams

Please	help	me.
Please	help	me.
Please help
Please help me.
	help me.

Output 3

Please

help

me.

N-grams

Please	help	me.
Please	help	me.
Please help
Please help me.
	help me.

Output 4

Please

help

me.

N-grams

Please	help	me.
Please	help	me.
Please help
Please help me.
	help me.

Sentence 361) BLEU: 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�o

��

�榡

�i�H

��

�H

Ref 0

this

the

right

documentation?

Ref 1

this

the

right

documentation?

Ref 2

Are

these

the

right

documents?

Ref 3

you

have

the

correct

papers?

Ref 4

this

the

correct

documentation?

Ref 5

this

the

right

documentation?

Output 0

This

kind

form

May?

N-grams

This

kind

form

May?

Output 1

this

format

kind

N-grams

this	format	kind	of	?
this

Output 2

This

format

OK?

N-grams

This

format

OK?

Output 3

This

kind

format

can?

N-grams

This

kind

format

can?

Output 4

This

kind

form

may?

N-grams

This

kind

form

may?

Sentence 362) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.6667/0.4/0.25/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0.7071 (1/0.75/0.6667/0.5) ; 0.5623 (1/0.6/0.5/0.3333)

Source

��

�Q

�I��

��

�C

Ref 0

would

exchange

some

money.

Ref 1

want

exchange

some

cash.

Ref 2

want

have

some

money

changed.

Ref 3

I'd

exchange

some

money.

Ref 4

would

exchange

some

money.

Ref 5

would

change

some

currency.

Output 0

want

exchange

money.

N-grams

I	want	to	exchange	money.
I	want	to	exchange	money.
I want		to exchange
I want to
I want to exchange
	want to
	want to exchange

Output 1

want

exchange

money

N-grams

i	want	to	exchange	money	.
	want	to	exchange	money
	want to
	want to exchange
		to exchange

Output 2

want

exchange

money.

N-grams

I	want	to	exchange	money.
I	want	to	exchange	money.
I want		to exchange
I want to
I want to exchange
	want to
	want to exchange

Output 3

want

exchange

money.

N-grams

I	want	to	exchange	money.
I	want	to	exchange	money.
I want		to exchange
I want to
I want to exchange
	want to
	want to exchange

Output 4

want

exchange

change

money.

N-grams

I	want	to	exchange	change	money.
I	want	to	exchange	change	money.
I want		to exchange
I want to
I want to exchange
	want to
	want to exchange

Sentence 363) BLEU: 1 (1/1/1/1) ; 0 (0.5/0/0/0) ; 1 (1/1/1/1) ; 0 (1/0.5/0/0) ; 0 (0.4/0/0/0)

Source

��

�s

��@��

�C

Ref 0

Please

call

ambulance.

Ref 1

Request

ambulance,

please.

Ref 2

Can

you

call

ambulance,

please?

Ref 3

Call

for

ambulance,

please.

Ref 4

Call

ambulance

please.

Ref 5

Call

ambulance,

please.

Output 0

Please

call

ambulance.

N-grams

Please	call	an	ambulance.
Please	call	an	ambulance.
Please call		an ambulance.
Please call an
Please call an ambulance.
	call an
	call an ambulance.

Output 1

please

call

ambulance

N-grams

please	call	ambulance	.
	call	ambulance

Output 2

Please

call

ambulance.

N-grams

Please	call	an	ambulance.
Please	call	an	ambulance.
Please call		an ambulance.
Please call an
Please call an ambulance.
	call an
	call an ambulance.

Output 3

Please

call

ambulance.

N-grams

Please	call	ambulance.
Please	call	ambulance.
Please call

Output 4

Please

called

the

ambulance.

N-grams

Please	be	called	the	ambulance.
Please				ambulance.

Sentence 364) BLEU: 0 (0.6/0.1111/0/0) ; 0 (0.7778/0.125/0/0) ; 0 (0.6/0.1111/0/0) ; 0 (0.6667/0.09091/0/0) ; 0 (0.5833/0.09091/0/0)

Source

�o

�O

�Ψ�

�~��

��

�٬O

�Ψ�

��

�H

Ref 0

this

drinking

water

finger

bowl?

Ref 1

this

water

for

drinking

finger

bowl?

Ref 2

this

water

potable

for

finger-washing?

Ref 3

this

glass

drinking

water

something

wash

your

hands

in?

Ref 4

this

finger

bowl

drinking

water?

Ref 5

this

finger

bowl

drinking

water?

Output 0

This

used

wash

their

hands

drink?

N-grams

This	is	used	to	wash	their	hands	or	to	drink?
	is		to	wash		hands	or
			to wash

Output 1

this

wash

hands

drink

N-grams

this	is	to	wash	hands	or	to	drink	?
this	is	to	wash	hands	or
		to wash

Output 2

This

used

wash

their

hands

drink?

N-grams

This	is	used	to	wash	their	hands	or	to	drink?
	is		to	wash		hands	or
			to wash

Output 3

This

use

wash

hands

use

drink?

N-grams

This	is	to	use	to	wash	hands	of	or	use	to	drink?
	is	to		to wash		hands	of	or
					wash

Output 4

This

uses

for

wash

the

hands

uses

for

drink?

N-grams

This	is	uses	for	to	wash	the	hands	uses	for	to	drink?
	is		for	to	wash		hands
				to wash

Sentence 365) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�H

��

�H

Ref 0

Are

there

any

letters

for

me?

Ref 1

there

any

mail

for

me?

Ref 2

there

any

post

for

me?

Ref 3

Did

any

letters

come

for

me?

Ref 4

Are

there

any

letters

for

me?

Ref 5

Are

there

any

letters

for

me?

Output 0

Has

given

the

letters?

N-grams

Has

given

the

letters?

Output 1

has

letter

N-grams

has

letter

Output 2

Has

given

the

letters?

N-grams

Has

given

the

letters?

Output 3

Have

letter?

N-grams

Have

letter?

Output 4

Has

for

mine

letter?

N-grams

Has	for	mine	letter?
	for

Sentence 366) BLEU: 0 (0.5/0.2857/0.1667/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.5/0.2857/0.1667/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�C

�T

��

�R

�@

��

�F��

�C

Ref 0

shopping

once

every

three

months.

Ref 1

shop

once

every

three

months.

Ref 2

Once

every

quarter,

shopping.

Ref 3

shopping

once

every

three

months.

Ref 4

shopping

four

times

year.

Ref 5

shopping

once

every

three

months.

Output 0

bought

the

first

thing

every

three

months.

N-grams

I	bought	the	first	thing	every	three	months.
I					every	three	months.
					every three
					every three months.
						three months.

Output 1

thing

every

three

months

buy

N-grams

i	thing	every	three	months	buy	.
		every	three
		every three

Output 2

bought

the

first

thing

every

three

months.

N-grams

I	bought	the	first	thing	every	three	months.
I					every	three	months.
					every three
					every three months.
						three months.

Output 3

buy

thing

every

three

months.

N-grams

I	buy	thing	every	three	months.
I			every	three	months.
			every three
			every three months.
				three months.

Output 4

every

three

months

buy

thing.

N-grams

My	every	three	months	buy	a	thing.
	every	three			a
	every three

Sentence 367) BLEU: 0 (0.5/0.2857/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.2222/0.125/0/0) ; 0 (0.5/0.2857/0/0) ; 0 (0.25/0/0/0)

Source

�o

��

�n�Y

��

�k��

�\�U

��

�H

Ref 0

Are

there

any

good

French

restaurants

around

here?

Ref 1

Are

there

good

French

restaurants

nearby?

Ref 2

Are

there

any

first-rate

French

restaurants

these

parts?

Ref 3

Are

there

any

good

French

restaurants

nearby?

Ref 4

there

good

French

restaurant

around

here?

Ref 5

Are

there

any

good

French

restaurants

this

area?

Output 0

There

delicious

French

restaurant

this

neighborhood?

N-grams

There	is	delicious	French	restaurant	in	this	neighborhood?
			French	restaurant	in	this
			French restaurant		in this

Output 1

this

the

french

restaurant

delicious

N-grams

this	is	the	french	restaurant	delicious	?
this				restaurant

Output 2

This

near

the

French

restaurant

have

delicious

it?

N-grams

This	is	near	the	French	restaurant	have	delicious	it?
				French	restaurant
				French restaurant

Output 3

There

delicious

French

restaurant

this

neighborhood?

N-grams

There	is	delicious	French	restaurant	in	this	neighborhood?
			French	restaurant	in	this
			French restaurant		in this

Output 4

Nearby

this

has

the

delicious

French

dining

room?

N-grams

Nearby	this	has	the	delicious	French	dining	room?
	this				French

Sentence 368) BLEU: 0.262 (0.5833/0.3636/0.2/0.1111) ; 0.3021 (0.7/0.3333/0.25/0.1429) ; 0.2998 (0.7273/0.4/0.2222/0.125) ; 0 (0.5385/0.1667/0/0) ; 0.262 (0.5833/0.3636/0.2/0.1111)

Source

�z

��

�e

�@

�i

��

�l��

��

�a��

��

�H

Ref 0

May

ask

you

draw

map

the

post

office?

Ref 1

Could

ask

you

draw

map

the

post

office

from

here?

Ref 2

Can

you

draw

map

the

post

office?

Ref 3

Could

ask

you

illustrate

the

way

the

post

office?

Ref 4

Could

ask

you

draw

map

the

post

office?

Ref 5

Could

you

draw

map

the

post

office?

Output 0

You

can

give

draw

one

the

post

office

map?

N-grams

You	can	give	me	to	draw	one	to	the	post	office	map?
			me	to	draw		to	the	post	office
				to draw			to the		post office
							to the post
							to the post office
								the post
								the post office

Output 1

can

you

give

the

post

office

map

N-grams

can	you	give	me	to	the	post	office	map	?
	you		me	to	the	post	office	map
				to the		post office
				to the post
				to the post office
					the post
					the post office

Output 2

Can

you

give

pictures

the

post

office

map?

N-grams

Can	you	give	me	pictures	to	the	post	office	a	map?
Can	you		me		to	the	post	office	a
Can you					to the		post office
					to the post
					to the post office
						the post
						the post office

Output 3

Can

you

give

the

map

that

makes

uniform

Zhang

Dao4's

post

office?

N-grams

Can

you

give

the

map

that

makes

uniform

Zhang

Dao4's

post

office?

Can

you

the

map

post

office?

Can you

post office?

Output 4

You

can

give

draw

one

the

post

office

map?

N-grams

You	can	give	me	to	draw	one	to	the	post	office	map?
			me	to	draw		to	the	post	office
				to draw			to the		post office
							to the post
							to the post office
								the post
								the post office

Sentence 369) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�X�I��

�}��

�H

Ref 0

What

time

you

open?

Ref 1

When

you

open?

Ref 2

What

are

your

opening

times?

Ref 3

What

time

will

you

open?

Ref 4

What

time

you

open?

Ref 5

What

time

you

open?

Output 0

few

minutes

open

the

door?

N-grams

few

minutes

open

the

door?

Output 1

open

the

door

N-grams

open

the

door

Output 2

few

minutes

open

the

door?

N-grams

few

minutes

open

the

door?

Output 3

several

o'clocks

open

the

door?

N-grams

several

o'clocks

open

the

door?

Output 4

How

many

o'clock

open

the

door?

N-grams

How

many

o'clock

open

the

door?

Sentence 370) BLEU: 0 (0.1111/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1111/0/0/0) ; 0 (0.25/0/0/0)

Source

�i�H

��}

��b

��

�H

Ref 0

Can

have

separate

checks,

please?

Ref 1

Could

have

separate

checks,

please?

Ref 2

Can

you

bill

separately,

please?

Ref 3

Could

get

separate

checks,

please?

Ref 4

Can

have

separate

checks,

please?

Ref 5

May

have

separate

checks,

please?

Output 0

all

right

separate

accounts?

N-grams

Is	it	all	right	to	separate	to	do	accounts?
					separate

Output 1

accounts

N-grams

accounts

Output 2

Accounts

can

separated

from

it?

N-grams

Accounts

can

separated

from

it?

Output 3

all

right

separate

accounts?

N-grams

Is	it	all	right	to	separate	to	do	accounts?
					separate

Output 4

May

accounts

separately?

N-grams

May	do	accounts	separately?
May

Sentence 371) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5)

Source

��

�Q

�h�f

�C

Ref 0

I'd

return

this.

Ref 1

want

return

this.

Ref 2

would

give

this

back.

Ref 3

I'd

return

this.

Ref 4

would

return

this.

Ref 5

I'd

return

this

item.

Output 0

want

return.

N-grams

I	want	to	return.
I	want	to
I want
I want to
	want to

Output 1

want

return

goods

N-grams

i	want	to	return	goods	.
	want	to	return
	want to
	want to return
		to return

Output 2

want

return.

N-grams

I	want	to	return.
I	want	to
I want
I want to
	want to

Output 3

think

return

goods.

N-grams

I	think	return	of	goods.
I		return

Output 4

want

return

goods.

N-grams

I	want	to	return	goods.
I	want	to	return
I want		to return
I want to
I want to return
	want to
	want to return

Sentence 372) BLEU: 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0/0/0/0)

Source

�b

�E

�Q

�E

��

�C

Ref 0

the

ninety-ninth

floor.

Ref 1

the

ninety-ninth

floor.

Ref 2

It's

the

ninety-ninth

storey.

Ref 3

It's

located

the

ninety-ninth

floor.

Ref 4

It's

the

ninety-ninth

floor.

Ref 5

located

the

ninety-ninth

floor.

Output 0

the

floor.

N-grams

In	the	99	floor.
	the		floor.

Output 1

the

floor

N-grams

in	the	floor	.
	the

Output 2

the

floor.

N-grams

In	the	99	floor.
	the		floor.

Output 3

the

99th

floor.

N-grams

BE	on	the	99th	floor.
	on	the		floor.
	on the

Output 4

nine

ten

nine

buildings.

N-grams

nine

ten

nine

buildings.

Sentence 373) BLEU: 0 (0.3333/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.3333/0.2/0/0)

Source

�o��

��

��~

�C

Ref 0

Dry

clean

this,

please.

Ref 1

Please

dry

clean

this.

Ref 2

Can

you

dry

clean

this,

please?

Ref 3

Dry

clean

this,

please.

Ref 4

Dry

clean

this,

please.

Ref 5

I'd

this

dry

cleaned,

please.

Output 0

Please

give

the

dry

cleaning.

N-grams

Please	give	me	the	dry	cleaning.
Please				dry

Output 1

please

dry

cleaning

this

N-grams

please	me	dry	cleaning	this	to	.
		dry		this

Output 2

Please

give

the

dry

cleaning.

N-grams

Please	give	me	the	dry	cleaning.
Please				dry

Output 3

This

invites

dry

cleaning

me.

N-grams

This	invites	dry	cleaning	to	me.
		dry

Output 4

This

please

dry

clean

me.

N-grams

This	please	dry	clean	to	me.
		dry	clean
		dry clean

Sentence 374) BLEU: 0 (0.5/0.2857/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.5/0.2857/0/0) ; 0 (0.2222/0.125/0/0)

Source

�z

�S

�ݨ�

�o��

��

�@

��

�饻

�k�H

��

�H

Ref 0

Did

you

see

Japanese

man

standing

around

here?

Ref 1

Did

you

see

Japanese

man

standing

this

area?

Ref 2

Was

there

Japanese

man

standing

around

here?

Ref 3

Have

you

seen

Japanese

man

standing

this

vicinity?

Ref 4

Did

you

notice

Japanese

man

standing

around

here?

Ref 5

Did

happen

you

see

Japanese

man

standing

around

here?

Output 0

Didn't

you

see

stand

here

Japanese

man?

N-grams

Didn't	you	see	stand	here	a	Japanese	man?
	you	see			a	Japanese
	you see				a Japanese

Output 1

you

not

see

here

japanese

man

N-grams

you	not	see	here	a	japanese	man	?
you		see		a		man

Output 2

You

did

not

see

here

stood

Japanese

man?

N-grams

You	did	not	see	here	stood	a	Japanese	man?
			see			a	Japanese
						a Japanese

Output 3

Didn't

you

see

stand

here

Japanese

man?

N-grams

Didn't	you	see	stand	here	a	Japanese	man?
	you	see			a	Japanese
	you see				a Japanese

Output 4

You

have

not

seen

here

station

Japan

man?

N-grams

You	have	not	seen	a	here	station	Japan	man?
			seen	a
			seen a

Sentence 375) BLEU: 0 (0.2222/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2222/0/0/0)

Source

�藍�_

�X�f

�b

��

�H

Ref 0

Excuse

me.
Where's

the

way

out?

Ref 1

Pardon

me.
How

get

out

here?

Ref 2

Excuse

me.
Where's

the

exit?

Ref 3

Pardon

me.
where

the

exit?

Ref 4

Excuse

me.
Where's

the

way

out?

Ref 5

Excuse

me.
Where's

the

way

out?

Output 0

Where

unfair

the

export

at?

N-grams

Where	is	unfair	to	the	export	to	be	at?
	is			the

Output 1

where

export

N-grams

where

export

Output 2

Where

beg

your

pardon

export?

N-grams

Where	I	beg	your	pardon	export?
	I

Output 3

Let

export

down

where?

N-grams

Let

export

down

where?

Output 4

Where

unfair

the

export

at?

N-grams

Where	is	unfair	to	the	export	to	be	at?
	is			the

Sentence 376) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�N

��

�@��

��

��u

�C

Ref 0

Okay,

please

the

fast

way.

Ref 1

Please

the

fast

way,

okay.

Ref 2

Okay,

please

take

the

quick

route.

Ref 3

Okay,

please

the

quick

way.

Ref 4

Okay,

please

take

the

fast

route.

Ref 5

Okay,

please

the

fast

way.

Output 0

Well,

that

went

faster

route.

N-grams

Well,	that	went	faster	route.
				route.

Output 1

that

route

some

N-grams

that

route

some

Output 2

Well,

that

went

faster

route.

N-grams

Well,	that	went	faster	route.
				route.

Output 3

walk

fast

some

routes.

N-grams

So	walk	fast	some	routes.
		fast

Output 4

Then

takes

the

quick

some

that

route.

N-grams

Then	takes	the	quick	some	that	route.
		the	quick			route.
		the quick

Sentence 377) BLEU: 0 (0.3333/0.25/0.1429/0) ; 0 (0.4444/0.25/0.1429/0) ; 0 (0.3/0.2222/0.125/0) ; 0 (0.3333/0.25/0.1429/0) ; 0 (0.1667/0/0/0)

Source

�A

�M

��

�H

�۳B

�o

�n

��

�H

Ref 0

How

you

get

along

with

your

co-workers?

Ref 1

you

get

along

with

your

co-workers?

Ref 2

How

you

get

with

your

colleagues?

Ref 3

How

you

and

your

co-workers

get

along?

Ref 4

How

you

get

with

your

co-workers?

Ref 5

How

you

get

along

with

your

colleagues?

Output 0

You

get

along

with

the

person

unit

well?

N-grams

You	get	along	with	the	person	of	unit	well?
	get	along	with
	get along
	get along with
		along with

Output 1

and

the

person

you

get

along

unit

N-grams

and	of	the	person	you	get	along	unit	?
and				you	get	along
				you get
				you get along
					get along

Output 2

And

units

the

person

you

get

along

all

right?

N-grams

And	units	of	the	person	you	get	along	all	right?
					you	get	along
					you get
					you get along
						get along

Output 3

You

get

along

with

the

person

unit

well?

N-grams

You	get	along	with	the	person	of	unit	well?
	get	along	with
	get along
	get along with
		along with

Output 4

You

and

unit's

people

are

together?

N-grams

You	and	unit's	people	are	together?
	and

Sentence 378) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.1429/0/0)

Source

��

�]

�O

��

�C

�L��

��

�t��

�u

��

�C

Ref 0

Me,

too.
They

play

really

well.

Ref 1

agree.
They

play

very

well.

Ref 2

Me,

too.
They

are

very

good.

Ref 3

Me,

too.
They

play

very

well.

Ref 4

Me,

too.
They

play

really

well.

Ref 5

Me,

too.
They

play

extremely

well.

Output 0

also.

Their

performance

really

very

good.

N-grams

I	also.	Their	performance	is	really	very	good.
I					really	very	good.
						very good.

Output 1

their

really

good

also

performance

N-grams

i	their	really	good	also	performance	.
		really

Output 2

ah.

Their

performances

are

really

good

ah.

N-grams

I	ah.	Their	performances	are	really	good	ah.
I				are	really

Output 3

also

yes.

Their

give

musical

performance

really

good.

N-grams

I	also	yes.	Their	give	musical	performance	really	good.
I							really	good.

Output 4

also.

Their

performance

really

very

good.

N-grams

I	also.	Their	performance	is	really	very	good.
I					really	very	good.
						very good.

Sentence 379) BLEU: 0 (0.875/0.5714/0.1667/0) ; 0 (0.3333/0/0/0) ; 0 (0.875/0.5714/0.1667/0) ; 0 (0.2/0/0/0) ; 0 (0.4/0/0/0)

Source

�h

��

�C

Ref 0

Please

hurry

the

airport.

Ref 1

Please

hurry

the

airport.

Ref 2

Please

rush

the

airport.

Ref 3

Please

get

the

airport

quickly

you

can.

Ref 4

Hurry

the

airport,

please.

Ref 5

Please

the

airport

fast

possible.

Output 0

Please

the

airport

soon

possible.

N-grams

Please	go	the	airport	as	soon	as	possible.
Please	go	the	airport	as		as	possible.
Please go		the airport				as possible.
		the airport as
			airport as

Output 1

please

airport

N-grams

please	airport	.
	airport

Output 2

Please

the

airport

soon

possible.

N-grams

Please	go	the	airport	as	soon	as	possible.
Please	go	the	airport	as		as	possible.
Please go		the airport				as possible.
		the airport as
			airport as

Output 3

Asking

airport

quicker.

N-grams

Asking	in	airport	is	quicker.
		airport

Output 4

Goes

airport

please

quick.

N-grams

Goes	to	airport	please	quick.
	to	airport

Sentence 380) BLEU: 0 (0.75/0.4286/0.1667/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.3/0.1111/0/0)

Source

��

��W

�_��

��

�P��

�Y�k

�C

Ref 0

woke

with

headache

this

morning.

Ref 1

This

morning,

woke

with

headache.

Ref 2

When

woke

this

morning

had

headache

Ref 3

head

was

pounding

when

woke

this

morning.

Ref 4

had

headache

when

woke

this

morning.

Ref 5

woke

this

morning

with

headache.

Output 0

After

getting

this

morning

was

headache.

N-grams

After	getting	up	this	morning	was	a	headache.
		up	this	morning	was	a	headache.
		up this				a headache.
		up this morning
			this morning

Output 1

after

getting

this

morning

headache

N-grams

after	getting	up	this	morning	headache	.
		up	this	morning	headache
		up this
		up this morning
			this morning

Output 2

After

getting

this

morning

was

headache.

N-grams

After	getting	up	this	morning	was	a	headache.
		up	this	morning	was	a	headache.
		up this				a headache.
		up this morning
			this morning

Output 3

After

getting

this

morning

feel

headache.

N-grams

After	getting	up	this	morning	feel	headache.
		up	this	morning		headache.
		up this
		up this morning
			this morning

Output 4

After

this

morning

gets

out

bed,

feels

the

headache.

N-grams

After	this	morning	gets	out	of	bed,	feels	the	headache.
	this	morning							headache.
	this morning

Sentence 381) BLEU: 0 (0.8333/0.2/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.8333/0.2/0/0) ; 0 (0/0/0/0)

Source

��

��t

��

�ȹC

��

�H

Ref 0

there

tour

which

includes

live

performance?

Ref 1

there

tour

that

includes

live

performance?

Ref 2

any

the

tours

include

live

performances?

Ref 3

Does

one

the

tours

include

live

performance?

Ref 4

there

tour

including

live

performance?

Ref 5

any

the

tours

include

live

performance?

Output 0

See

the

tour

the

performance?

N-grams

See	the	tour	of	the	performance?
	the	tour	of		performance?
			of the

Output 1

the

performance

N-grams

the	performance	?
the

Output 2

Have

you

watch

the

travel

show?

N-grams

Have	you	watch	the	travel	show?
			the

Output 3

See

the

tour

the

performance?

N-grams

See	the	tour	of	the	performance?
	the	tour	of		performance?
			of the

Output 4

Has

looks

performance's

traveling?

N-grams

Has

looks

performance's

traveling?

Sentence 382) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�F

�o

��

��P

�C

Ref 0

I've

been

taking

easy.

Ref 1

have

been

relaxing.

Ref 2

I've

been

relaxing.

Ref 3

I've

been

taking

easy.

Ref 4

have

been

taking

easy.

Ref 5

I've

been

taking

easy.

Output 0

very

easily.

N-grams

very

easily.

Output 1

very

N-grams

very

Output 2

very

easily.

N-grams

very

easily.

Output 3

Doing

lightly

loose.

N-grams

Doing

lightly

loose.

Output 4

Does

very

much

with

ease.

N-grams

Does

very

much

with

ease.

Sentence 383) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.25/0/0/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.1667/0/0/0) ; 0 (0.3/0/0/0)

Source

�X��

��B

�b

��

�H

Ref 0

Where

taxi

stand?

Ref 1

Where

the

taxi

stand?

Ref 2

Where

can

get

taxi?

Ref 3

Where

taxi

stand?

Ref 4

Where

there

taxi

stand?

Ref 5

Where

taxi

stand?

Output 0

Where

taxi

ride

in?

N-grams

Where	is	a	taxi	ride	in?
Where	is	a	taxi
Where is		a taxi
Where is a
Where is a taxi
	is a
	is a taxi

Output 1

where

ride

does

the

car

N-grams

where	a	ride	in	does	the	car	?
	a				the

Output 2

Where

taxi

ride

in?

N-grams

Where	is	a	taxi	ride	in?
Where	is	a	taxi
Where is		a taxi
Where is a
Where is a taxi
	is a
	is a taxi

Output 3

Where

does

the

for-rent

car

placed

in?

N-grams

Where	does	the	for-rent	car	go	by	car	to	be	placed	in?
Where		the

Output 4

Where

does

the

rental

car

ride

carriage

occupies?

N-grams

Where	does	the	rental	car	ride	in	a	carriage	occupies?
Where		the					a

Sentence 384) BLEU: 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.4286/0.1667/0/0) ; 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.2857/0/0/0) ; 0 (0.5/0.1429/0/0)

Source

�H

��

�n

�h��

��

�H

Ref 0

How

much

will

airmail?

Ref 1

What

the

cost

airmail?

Ref 2

How

much

would

cost

send

air?

Ref 3

How

much

will

cost

send

via

airmail?

Ref 4

How

much

will

cost

airmail?

Ref 5

How

much

will

cost

send

airmail?

Output 0

How

much

does

cost

send

aviation?

N-grams

How	much	does	it	cost	to	send	aviation?
How	much		it	cost	to	send
How much			it cost		to send
			it cost to
			it cost to send
				cost to
				cost to send

Output 1

how

much

send

aviation

want

N-grams

how	much	to	send	aviation	want	?
	much	to	send
		to send

Output 2

How

much

does

cost

send

aviation?

N-grams

How	much	does	it	cost	to	send	aviation?
How	much		it	cost	to	send
How much			it cost		to send
			it cost to
			it cost to send
				cost to
				cost to send

Output 3

Send

aviation

want

how

much

N-grams

Send	aviation	to	want	how	much	?
		to			much

Output 4

How

much

money

sends

the

aviation

want?

N-grams

How	much	money	sends	the	aviation	to	want?
How	much			the		to
How much

Sentence 385) BLEU: 0 (0.3333/0.125/0/0) ; 0 (0.6/0/0/0) ; 0 (0.8333/0.4/0.25/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.6667/0.4/0/0)

Source

��

�O

¾�~

�L��

�g

�C

Ref 0

I'm

pro

wrestling

fan.

Ref 1

fan

pro

wrestling.

Ref 2

pro

wrestling

enthusiast.

Ref 3

I'm

pro

wrestling

fan.

Ref 4

I'm

pro

wrestling

fan.

Ref 5

I'm

fan

pro

wrestling.

Output 0

occupation

wrestling

fond

of.

N-grams

I	am	an	occupation	wrestling	to	be	fond	of.
I	am			wrestling
I am

Output 1

wrestling

fan

N-grams

i	am	wrestling	fan	.
	am	wrestling	fan

Output 2

wrestling

fan

career.

N-grams

I	am	a	wrestling	fan	career.
I	am	a	wrestling	fan
I am
I am a
	am a

Output 3

occupation

wrestling

fond

of.

N-grams

I	am	an	occupation	wrestling	to	be	fond	of.
I	am			wrestling
I am

Output 4

the

professional

wrestling

fan.

N-grams

I	am	the	professional	wrestling	fan.
I	am			wrestling	fan.
I am				wrestling fan.

Sentence 386) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

��b

�C

Ref 0

Can

have

check,

please.

Ref 1

Could

have

the

bill,

please.

Ref 2

would

the

bill,

please.

Ref 3

Could

get

check,

please.

Ref 4

I'd

check,

please.

Ref 5

Can

you

give

check,

please?

Output 0

Check,

please.

N-grams

Check,	please.
	please.

Output 1

please

N-grams

please

Output 2

Check,

please.

N-grams

Check,	please.
	please.

Output 3

Please

ring

up.

N-grams

Please

ring

up.

Output 4

Please

pay

up.

N-grams

Please

pay

up.

Sentence 387) BLEU: 0 (1/1/1/0) ; 0 (0.4/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.3333/0/0)

Source

��

�O

��

�a��

�H

Ref 0

Where

that?

Ref 1

Where's

that?

Ref 2

Where

it?

Ref 3

Where

that?

Ref 4

Where

that?

Ref 5

Where

that

located?

Output 0

Where

that?

N-grams

Where	is	that?
Where	is	that?
Where is
Where is that?
	is that?

Output 1

what

place

that

N-grams

what	is	place	that	?
	is		that

Output 2

What

this

place?

N-grams

What	is	this	place?
	is

Output 3

Where

that

N-grams

Where	is	that	?
Where	is	that
Where is
Where is that
	is that

Output 4

What

place

that?

N-grams

What	place	is	that?
		is	that?
		is that?

Sentence 388) BLEU: 1 (1/1/1/1) ; 0 (0.4/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.5/0.4/0.25/0) ; 0 (0/0/0/0)

Source

��

�X�f

�b

��

�H

Ref 0

Where's

the

nearest

exit?

Ref 1

Where

the

closest

exit?

Ref 2

Where's

the

closest

way

out?

Ref 3

Where's

the

nearest

exit?

Ref 4

Where

the

nearest

exit?

Ref 5

Where's

the

closest

exit?

Output 0

Where

the

nearest

exit?

N-grams

Where	is	the	nearest	exit?
Where	is	the	nearest	exit?
Where is		the nearest
Where is the			nearest exit?
Where is the nearest
	is the
	is the nearest
	is the nearest exit?
		the nearest exit?

Output 1

where

the

exit

N-grams

where	is	the	exit	?
	is	the
	is the

Output 2

Where

the

nearest

exit?

N-grams

Where	is	the	nearest	exit?
Where	is	the	nearest	exit?
Where is		the nearest
Where is the			nearest exit?
Where is the nearest
	is the
	is the nearest
	is the nearest exit?
		the nearest exit?

Output 3

Where

the

last

exit

N-grams

Where	is	the	last	exit	?
Where	is	the
Where is
Where is the
	is the

Output 4

Recently

export

where?

N-grams

Recently

export

where?

Sentence 389) BLEU: 0.7071 (1/1/0.75/0.3333) ; 0 (0.5714/0.3333/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0.7071 (1/1/0.75/0.3333) ; 0.7071 (1/1/0.75/0.3333)

Source

��

�Q

��

�C

Ref 0

I'd

rent

car.

Ref 1

would

rent

car.

Ref 2

want

lease

car.

Ref 3

I'd

rent

car.

Ref 4

I'd

rent

car.

Ref 5

I'd

rent

automobile.

Output 0

want

rent

car.

N-grams

I	want	to	rent	a	car.
I	want	to	rent	a	car.
I want		to rent		a car.
I want to			rent a
	want to		rent a car.
		to rent a
		to rent a car.

Output 1

want

car

rent

N-grams

i	want	to	car	rent	a	.
	want	to		rent	a
	want to			rent a

Output 2

want

car

rental.

N-grams

I	want	to	car	rental.
I	want	to
I want
I want to
	want to

Output 3

want

rent

car.

N-grams

I	want	to	rent	a	car.
I	want	to	rent	a	car.
I want		to rent		a car.
I want to			rent a
	want to		rent a car.
		to rent a
		to rent a car.

Output 4

want

rent

car.

N-grams

I	want	to	rent	a	car.
I	want	to	rent	a	car.
I want		to rent		a car.
I want to			rent a
	want to		rent a car.
		to rent a
		to rent a car.

Sentence 390) BLEU: 1 (1/1/1/1) ; 0 (0.5/0/0/0) ; 1 (1/1/1/1) ; 0 (0.1429/0/0/0) ; 0 (0.6667/0.2/0/0)

Source

��

�s

�p��

��l

�C

Ref 0

name

Akiko

Ono.

Ref 1

Akiko

Ono

name.

Ref 2

called

Akiko

Ono.

Ref 3

name

Akiko

Ono.

Ref 4

name

Akiko

Ono.

Ref 5

name

Akiko

Ono.

Output 0

name

Akiko

Ono.

N-grams

My	name	is	Akiko	Ono.
My	name	is	Akiko	Ono.
My name		is Akiko
My name is			Akiko Ono.
My name is Akiko
	name is
	name is Akiko
	name is Akiko Ono.
		is Akiko Ono.

Output 1

name

ono

N-grams

my	name	ono	.
my	name

Output 2

name

Akiko

Ono.

N-grams

My	name	is	Akiko	Ono.
My	name	is	Akiko	Ono.
My name		is Akiko
My name is			Akiko Ono.
My name is Akiko
	name is
	name is Akiko
	name is Akiko Ono.
		is Akiko Ono.

Output 3

call

small

wild

and

clear

son.

N-grams

I	call	small	wild	and	clear	son.
I

Output 4

name

Ono

Ming

Zi.

N-grams

My	name	am	Ono	Ming	Zi.
My	name	am	Ono
My name

Sentence 391) BLEU: 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.1429/0/0/0)

Source

�o

��

�H�Υd

�i�H

��

�H

Ref 0

you

this

credit

card?

Ref 1

you

take

this

credit

card?

Ref 2

you

this

credit

card?

Ref 3

you

this

credit

card?

Ref 4

you

this

credit

card?

Ref 5

you

this

credit

card?

Output 0

Can

this

kind

credit

card

used?

N-grams

Can	this	kind	of	credit	card	be	used?
	this			credit

Output 1

this

card

can

use

kind

credit

N-grams

this	card	can	use	kind	of	credit	?
this						credit

Output 2

This

card

can

use

it?

N-grams

This

card

can

use

it?

Output 3

Can

this

kind

credit

card

used?

N-grams

Can	this	kind	of	credit	card	be	used?
	this			credit

Output 4

This

kind

credit

card

may

use?

N-grams

This	kind	of	credit	card	may	use?
			credit

Sentence 392) BLEU: 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0.1429/0/0)

Source

�n

�ĩ�

�L

�j

��

�F��

�C

Ref 0

don't

want

anything

too

strong.

Ref 1

don't

want

anything

very

strong.

Ref 2

not

want

anything

too

strong.

Ref 3

want

something

that's

not

too

strong.

Ref 4

Nothing

too

strong,

please.

Ref 5

Nothing

too

strong,

thank

you.

Output 0

not

have

strong

East-west

medicine.

N-grams

Do	not	have	a	strong	East-west	medicine.
	not

Output 1

not

strong

medicine

the

thing

N-grams

not	strong	medicine	the	thing	.
not

Output 2

not

have

strong

East-West

medicine.

N-grams

Do	not	have	a	strong	East-West	medicine.
	not

Output 3

Don't

the

medicine

leads

strong

thing.

N-grams

Don't

the

medicine

leads

strong

thing.

Output 4

Does

not

want

the

property

excessively

strong

thing.

N-grams

Does	not	want	the	property	excessively	strong	thing.
	not	want
	not want

Sentence 393) BLEU: 0.5814 (0.8/0.6667/0.5/0.4286) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0.2985 (0.4444/0.375/0.2857/0.1667) ; 0.5193 (0.7273/0.6/0.4444/0.375) ; 0 (0.2222/0/0/0)

Source

�h

�۴�

��

��Z��

�O

�X�I

�H

Ref 0

What

time

the

last

train

London?

Ref 1

What

time

the

last

train

London?

Ref 2

When

the

last

train

for

London?

Ref 3

What

time

does

the

last

train

London

leave?

Ref 4

When

the

last

train

London?

Ref 5

What

time

does

the

last

train

leave

for

London?

Output 0

What

time

the

last

train

that

goes

London?

N-grams

What	time	is	the	last	train	that	goes	to	London?
What	time	is	the	last	train			to	London?
What time		is the		last train				to London?
What time is			the last
What time is the
	time is		the last train
	time is the
	time is the last
		is the last
		is the last train

Output 1

the

last

train

london

goes

N-grams

the	last	train	to	london	is	goes	?
the	last	train	to		is
the last		train to
the last train
the last train to
	last train
	last train to

Output 2

The

last

train

London

are

few

points?

N-grams

The	last	train	to	London	are	a	few	points?
	last	train	to	London
	last train		to London
	last train to
	last train to London
		train to
		train to London

Output 3

What

time

the

last

train

that

goes

London

N-grams

What	time	is	the	last	train	that	goes	to	London	?
What	time	is	the	last	train			to	London
What time		is the		last train				to London
What time is			the last
What time is the
	time is		the last train
	time is the
	time is the last
		is the last
		is the last train

Output 4

How

many

spots

goes

London's

last

bus

is?

N-grams

How	many	spots	goes	to	London's	last	bus	is?
				to		last

Sentence 394) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��I

��

�H

Ref 0

How

about

five

o'clock?

Ref 1

What

about

five

o'clock?

Ref 2

What

about

five

o'clock?

Ref 3

How's

five

o'clock?

Ref 4

How

does

five

o'clock

sound?

Ref 5

How

would

five

o'clock

be?

Output 0

Five

spots

are

what

kind

of?

N-grams

Five

spots

are

what

kind

of?

Output 1

how

N-grams

how

Output 2

How

o'clock?

N-grams

How	to	5	o'clock?
How			o'clock?

Output 3

5:00

how?

N-grams

5:00

how?

Output 4

Five

spots

are

what

kind

of?

N-grams

Five

spots

are

what

kind

of?

Sentence 395) BLEU: 0 (0.08333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.08333/0/0/0) ; 0 (0/0/0/0)

Source

�p��ù��

�C

�]

��w

�س��f�ȴ�

�C

Ref 0

Rene

Russo.
But

Cameron

Diaz,

too.

Ref 1

Rene

Russo.
However,

also

Cameron

Diaz.

Ref 2

Rene

Russo.
But

also

Cameron

Diaz.

Ref 3

Rene

Russo.
But

Cameron

Diaz,

well.

Ref 4

Rene

Russo.
But

Cameron

Diaz,

too.

Ref 5

Rene

Russo.
But

Cameron

Diaz

also.

Output 0

The

Thunder

nero

plain.

Also

cameroon

the

second

si.

N-grams

The	Thunder	nero	is	plain.	Also	like	cameroon	the	di	second	si.
						like

Output 1

also

cameroon

N-grams

also	cameroon	.
also

Output 2

Su-雷尼羅.

Also

enjoy狄亞斯Cameroon.

N-grams

Su-雷尼羅.

Also

enjoy狄亞斯Cameroon.

Output 3

The

thunder

Nero

plain.

Also

Cameroon

the

second

Si.

N-grams

The	thunder	Nero	is	plain.	Also	like	Cameroon	the	Di	second	Si.
						like

Output 4

Reyne

Russell.

Also

likes

Cameroon

Diyasi.

N-grams

Reyne

Russell.

Also

likes

Cameroon

Diyasi.

Sentence 396) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�O

�@

��

��x

�C

Ref 0

Track

number

one.

Ref 1

Track

number

one.

Ref 2

Track

number

one.

Ref 3

Track

number

one.

Ref 4

Track

number

one.

Ref 5

Track

number

one.

Output 0

the

first

platform.

N-grams

the

first

platform.

Output 1

the

platform

N-grams

the

platform

Output 2

Are

the

1st

platform.

N-grams

Are

the

1st

platform.

Output 3

No.1

website.

N-grams

No.1

website.

Output 4

the

first

platform.

N-grams

the

first

platform.

Sentence 397) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�w��

�F

�C

Ref 0

got

car-sick.

Ref 1

was

sick

the

car.

Ref 2

was

car-sick.

Ref 3

got

car-sick.

Ref 4

got

car-sick.

Ref 5

got

motion

sickness.

Output 0

motion

sickness.

N-grams

A	motion	sickness.
	motion	sickness.
	motion sickness.

Output 1

N-grams

Output 2

motion

sickness.

N-grams

A	motion	sickness.
	motion	sickness.
	motion sickness.

Output 3

Car-sick.

N-grams

Car-sick.

Output 4

Carsickness.

N-grams

Carsickness.

Sentence 398) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�즸��

�C

Ref 0

Nice

meet

you,

too.

Ref 1

It's

nice

meet

you

also.

Ref 2

Pleased

meet

you,

too.

Ref 3

It's

nice

meet

you,

too.

Ref 4

Nice

meet

you,

too.

Ref 5

Pleasure

meet

you,

too.

Output 0

The

first

time

meets.

N-grams

The

first

time

meets.

Output 1

first

meeting

N-grams

first

meeting

Output 2

First

meeting.

N-grams

First

meeting.

Output 3

The

first

time

meets.

N-grams

The

first

time

meets.

Output 4

First

meeting.

N-grams

First

meeting.

Sentence 399) BLEU: 1 (1/1/1/1) ; 0 (0.25/0/0/0) ; 0 (1/0.5/0/0) ; 0 (0.3333/0/0/0) ; 1 (1/1/1/1)

Source

��

�a

�s��

��K

�H

Ref 0

Which

hotel

convenient?

Ref 1

Which

hotel

convenient?

Ref 2

Which

hotel

the

most

suited?

Ref 3

Which

hotel

convenient?

Ref 4

Which

hotel

accessible?

Ref 5

Which

hotel

convenient?

Output 0

Which

hotel

convenient?

N-grams

Which	hotel	is	convenient?
Which	hotel	is	convenient?
Which hotel		is convenient?
Which hotel is
Which hotel is convenient?
	hotel is
	hotel is convenient?

Output 1

which

hotel

convenient

N-grams

which	hotel	convenient	?
	hotel

Output 2

Which

hotel

convenient?

N-grams

Which	hotel	convenient?
Which	hotel	convenient?
Which hotel

Output 3

Which

cabaret

convenience?

N-grams

Which	cabaret	convenience?
Which

Output 4

Which

hotel

convenient?

N-grams

Which	hotel	is	convenient?
Which	hotel	is	convenient?
Which hotel		is convenient?
Which hotel is
Which hotel is convenient?
	hotel is
	hotel is convenient?

Sentence 400) BLEU: 0 (0.2857/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.1818/0/0/0)

Source

�n

��}

�C

��

�u

�[

��

�C

Ref 0

sugar.
Only

milk,

please.

Ref 1

Milk,

sugar,

please.

Ref 2

Milk

only

please.
No

sugar.

Ref 3

sugar.
Just

milk,

please.

Ref 4

sugar.
Only

milk,

please.

Ref 5

Just

milk,

sugar,

please.

Output 0

Don't

sugar.

Please

only

fill

with

milk.

N-grams

Don't	sugar.	Please	only	fill	with	milk.
	sugar.		only

Output 1

not

sugar

please

only

add

milk

N-grams

not	sugar	please	only	add	milk	.
			only

Output 2

not

sugar.

Please

only

add

milk.

N-grams

Do	not	sugar.	Please	only	add	milk.
		sugar.		only

Output 3

Don't

sugar.

Please

only

fill

with

milk.

N-grams

Don't	sugar.	Please	only	fill	with	milk.
	sugar.		only

Output 4

Does

not

want

the

hard

sugar.

Please

only

add

the

milk.

N-grams

Does	not	want	the	hard	sugar.	Please	only	add	the	milk.
					sugar.		only

Sentence 401) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.1667/0/0/0)

Source

�A

�b

��

�H

Ref 0

Are

you

kidding

me?

Ref 1

Are

you

fooling

with

me?

Ref 2

You're

joking?

Ref 3

Are

you

joking?

Ref 4

Are

you

kidding

me?

Ref 5

Are

you

serious?

Output 0

Are

you

making

fun

me?

N-grams

Are	you	making	fun	of	me?
Are	you				me?
Are you

Output 1

you

are

N-grams

you	me	are	?
you

Output 2

You

tease

me?

N-grams

You	tease	me?
		me?

Output 3

Are

you

making

fun

me?

N-grams

Are	you	making	fun	of	me?
Are	you				me?
Are you

Output 4

You

are

playing

tricks

me?

N-grams

You	are	playing	tricks	on	me?
					me?

Sentence 402) BLEU: 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.1667/0/0/0)

Source

�n

��I

�F

�C

Ref 0

dessert,

thanks.

Ref 1

Thank

you.
No

dessert.

Ref 2

dessert,

thank

you.

Ref 3

don't

want

dessert,

thank

you.

Ref 4

dessert,

thanks.

Ref 5

dessert

for

me,

thank

you.

Output 0

Don't

dessert.

N-grams

Don't	dessert.
	dessert.

Output 1

not

dessert

N-grams

not	dessert	.
	dessert

Output 2

Not

dessert.

N-grams

Not	a	dessert.
		dessert.

Output 3

Don't

dessert.

N-grams

Don't	dessert.
	dessert.

Output 4

Did

not

want

the

sweet

snack.

N-grams

Did	not	want	the	sweet	snack.
		want

Sentence 403) BLEU: 0 (1/0.6667/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0.6667/0/0) ; 0 (0.75/0.3333/0/0)

Source

�Z��

��

�F

�C

Ref 0

The

toilet

stopped

up.

Ref 1

The

toilet

blocked.

Ref 2

The

toilet's

blocked.

Ref 3

The

toilet's

clogged.

Ref 4

The

toilet

clogged.

Ref 5

The

toilet

blocked

up.

Output 0

The

toilet

blocked

up.

N-grams

The	toilet	blocked	up.
The	toilet	blocked	up.
The toilet		blocked up.

Output 1

the

toilet

N-grams

the	toilet	up	.
	toilet

Output 2

Plugging

the

toilet.

N-grams

Plugging

the

toilet.

Output 3

The

toilet

blocked

up.

N-grams

The	toilet	blocked	up.
The	toilet	blocked	up.
The toilet		blocked up.

Output 4

The

restroom

stopped

up.

N-grams

The	restroom	stopped	up.
The		stopped	up.
		stopped up.

Sentence 404) BLEU: 0 (0.1111/0/0/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.4545/0.2/0/0) ; 0 (0.1111/0/0/0) ; 0 (0.4/0/0/0)

Source

��

�W�r

�i�D

��

�{��

��

�H

�C

Ref 0

don't

give

name

strangers.

Ref 1

don't

divulge

name

strangers.

Ref 2

not

give

details

strangers.

Ref 3

don't

give

name

out

people

don't

know.

Ref 4

not

tell

name

strangers.

Ref 5

don't

give

name

people

not

know..

Output 0

Can't

tell

the

person

that

doesn't

know

the

name.

N-grams

Can't	tell	the	person	that	doesn't	know	the	name.
	tell

Output 1

can

not

tell

know

the

name

the

person

N-grams

can	not	tell	know	the	name	the	person	.
	not	tell			name
	not tell

Output 2

Can

not

tell

not

know

the

name

the

person.

N-grams

Can	not	tell	do	not	know	the	name	of	the	person.
	not	tell	do				name
	not tell		do not

Output 3

Can't

tell

the

person

that

doesn't

know

the

name.

N-grams

Can't	tell	the	person	that	doesn't	know	the	name.
	tell

Output 4

Cannot

tell

the

name

the

human

who

did

not

know.

N-grams

Cannot	tell	the	name	the	human	who	did	not	know.
	tell		name					not	know.

Sentence 405) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.25/0.1429/0/0)

Source

�b

�o��

�i�H

��z

�n��

��

�H

Ref 0

Can

you

check

here?

Ref 1

Could

you

check

here?

Ref 2

Can

you

check

here?

Ref 3

Can

check

here?

Ref 4

Can

checked

here?

Ref 5

Can

you

here?

Output 0

You

can

check

it?

N-grams

You	can	check	it?
		check

Output 1

can

boarding

here

N-grams

can

boarding

here

Output 2

You

can

check

it?

N-grams

You	can	check	it?
		check

Output 3

Can

carry

out

boarding

procedure

here?

N-grams

Can	carry	out	a	boarding	procedure	here?
Can						here?

Output 4

May

through

the

boarding

formalities

here?

N-grams

May	go	through	the	boarding	formalities	in	here?
						in	here?
						in here?

Sentence 406) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5/0.2/0/0)

Source

��

�i�D

��

�g

�H

Ref 0

Can

you

tell

how

fill

out

this

form?

Ref 1

Could

you

explain

how

fill

out

this

form?

Ref 2

Would

you

mind

showing

how

complete

this

form?

Ref 3

Could

you

show

how

complete

this

form?

Ref 4

Can

you

tell

how

complete

this

form?

Ref 5

Can

you

show

how

fill

out

this

form?

Output 0

Please

tell

how

write?

N-grams

Please	tell	me	how	to	write?
	tell	me	how	to
	tell me		how to
	tell me how
	tell me how to
		me how
		me how to

Output 1

please

tell

how

write

N-grams

please	tell	me	how	to	write	?
	tell	me	how	to
	tell me		how to
	tell me how
	tell me how to
		me how
		me how to

Output 2

Please

tell

how

write?

N-grams

Please	tell	me	how	to	write?
	tell	me	how	to
	tell me		how to
	tell me how
	tell me how to
		me how
		me how to

Output 3

Please

tell

how

write?

N-grams

Please	tell	me	how	to	write?
	tell	me	how	to
	tell me		how to
	tell me how
	tell me how to
		me how
		me how to

Output 4

How

please

tell

write?

N-grams

How	please	tell	me	to	write?
		tell	me	to
		tell me

Sentence 407) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.5/0.2/0/0)

Source

��J

�n

�X

��

�H

Ref 0

How

many

eggs

would

you

like?

Ref 1

How

many

eggs

would

you

like?

Ref 2

How

many

eggs

would

you

like?

Ref 3

How

many

eggs

you

want?

Ref 4

How

many

eggs

would

you

like?

Ref 5

How

many

eggs?

Output 0

How

many

does

the

egg

want?

N-grams

How	many	does	the	egg	want?
How	many				want?
How many

Output 1

how

many

does

the

egg

want

N-grams

how	many	does	the	egg	want	?
	many

Output 2

Eggs

few?

N-grams

Eggs

few?

Output 3

How

many

does

the

egg

want?

N-grams

How	many	does	the	egg	want?
How	many				want?
How many

Output 4

How

many

does

the

egg

want?

N-grams

How	many	does	the	egg	want?
How	many				want?
How many

Sentence 408) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.5/0/0/0)

Source

��

�ɭ�

�}�l

��

�H

Ref 0

When

did

start?

Ref 1

When

did

begin?

Ref 2

what

time

did

begin?

Ref 3

What

time

did

begin?

Ref 4

When

did

start?

Ref 5

When

did

start?

Output 0

When

did

you

start?

N-grams

When	did	you	start?
When	did		start?
When did

Output 1

when

N-grams

when

Output 2

When

started?

N-grams

When	started?
When

Output 3

When

did

you

start?

N-grams

When	did	you	start?
When	did		start?
When did

Output 4

When

starts?

N-grams

When	starts?
When

Sentence 409) BLEU: 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0)

Source

��

�E�I

��

�n

�C

Ref 0

will

ready

nine

tomorrow.

Ref 1

will

ready

tomorrow

nine.

Ref 2

should

ready

tomorrow

nine.

Ref 3

It'll

ready

nine

tomorrow.

Ref 4

will

ready

nine

tomorrow.

Ref 5

will

ready

nine

o'clock

tomorrow.

Output 0

Tomorrow

can

well.

N-grams

Tomorrow

can

well.

Output 1

tomorrow

can

N-grams

9	:	00	tomorrow	can	.
			tomorrow

Output 2

9:00

tomorrow

improve

our

communication.

N-grams

9:00	tomorrow	to	improve	our	communication.
	tomorrow

Output 3

9:00

tomorrow

can

complete.

N-grams

9:00	tomorrow	can	complete.
	tomorrow

Output 4

Tomorrow

9:00

can

well.

N-grams

Tomorrow

9:00

can

well.

Sentence 410) BLEU: 0 (0.6667/0.4/0.25/0) ; 0 (0.25/0/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.125/0/0/0) ; 0 (0/0/0/0)

Source

W��

��

�d

��

�I��

�C

Ref 0

Please

make

the

top

little

longer.

Ref 1

Please

make

the

top

bit

longer.

Ref 2

Can

you

please

make

the

top

bit

longer?

Ref 3

Please

lengthen

the

top.

Ref 4

Please

make

the

top

little

longer.

Ref 5

Please

make

the

top

little

longer.

Output 0

Above,

please

stay

little

longer.

N-grams

Above,	please	stay	a	little	longer.
	please		a	little	longer.
			a little
			a little longer.
				little longer.

Output 1

please

stay

grow

N-grams

please	stay	grow	.
please

Output 2

Above,

please

stay

little

longer.

N-grams

Above,	please	stay	a	little	longer.
	please		a	little	longer.
			a little
			a little longer.
				little longer.

Output 3

please

stay

grow

order

son.

N-grams

Up	please	stay	to	grow	to	order	son.
	please

Output 4

requests

personally

lets

grow

long.

N-grams

requests

personally

lets

grow

long.

Sentence 411) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�N��

�b��

��

�C

Ref 0

I'd

cooked

medium.

Ref 1

would

medium.

Ref 2

I'd

done

medium.

Ref 3

would

done

medium.

Ref 4

I'd

cooked

medium.

Ref 5

Cooked

medium,

please.

Output 0

Please

roasted

meat

the

rare.

N-grams

Please

roasted

meat

the

rare.

Output 1

please

meat

the

roast

N-grams

please

meat

the

roast

Output 2

Please

roasted

meat

the

rare.

N-grams

Please

roasted

meat

the

rare.

Output 3

The

meat

asks

roast

half-baked.

N-grams

The

meat

asks

roast

half-baked.

Output 4

The

meat

please

roast

the

half

ripe.

N-grams

The

meat

please

roast

the

half

ripe.

Sentence 412) BLEU: 0.2907 (0.6/0.3333/0.25/0.1429) ; 0 (0.625/0/0/0) ; 0.2907 (0.6/0.3333/0.25/0.1429) ; 0 (0.3/0/0/0) ; 0 (0/0/0/0)

Source

�

��L

��

�C

�N

�b

��]

��

�e��

�C

Ref 0

You

can't

miss

it.
You'll

find

just

front

the

hotel.

Ref 1

You

won't

able

miss

it.
You

will

find

just

front

the

hotel.

Ref 2

You

can't

fail

see

it.
It

just

front

the

hotel.

Ref 3

There's

way

you

can

miss

it.
You

will

find

right

front

the

hotel.

Ref 4

You

cannot

miss

it.
It's

just

front

the

hotel.

Ref 5

You

can't

miss

it.
It's

just

front

the

hotel.

Output 0

Will

not

missed.

the

front

the

hotel.

N-grams

Will	not	be	missed.	On	the	front	of	the	hotel.
		be			the	front	of	the hotel.
						front of			hotel.
						front of the
						front of the hotel.
							of the
							of the hotel.

Output 1

will

not

the

miss

ahead

N-grams

will	not	the	of	miss	in	ahead	.
will		the	of	miss	in

Output 2

Will

not

missed.

the

front

the

hotel.

N-grams

Will	not	be	missed.	On	the	front	of	the	hotel.
		be			the	front	of	the hotel.
						front of			hotel.
						front of the
						front of the hotel.
							of the
							of the hotel.

Output 3

Will

not

miss.

the

guest

house

right

ahead.

N-grams

Will	not	miss.	In	the	guest	house	of	right	ahead.
				the			of	right

Output 4

Will

not

miss.

guesthouse

dead

ahead.

N-grams

Will

not

miss.

guesthouse

dead

ahead.

Sentence 413) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0/0/0/0)

Source

�o

�O

�u��

��

�H

Ref 0

this

real

leather?

Ref 1

this

genuine

leather?

Ref 2

this

leather

real?

Ref 3

this

real

leather?

Ref 4

this

authentic

leather?

Ref 5

this

made

real

leather?

Output 0

this

the

leather?

N-grams

Is	this	the	leather?
Is	this		leather?
Is this

Output 1

this

the

dermis

N-grams

this	is	the	dermis	?
this

Output 2

This

the

dermis

it?

N-grams

This

the

dermis

it?

Output 3

this

the

leather?

N-grams

Is	this	the	leather?
Is	this		leather?
Is this

Output 4

This

the

dermis?

N-grams

This

the

dermis?

Sentence 414) BLEU: 0 (0.8/0.4444/0.25/0) ; 0 (0/0/0/0) ; 0 (0.8/0.4444/0.25/0) ; 0 (0.1818/0/0/0) ; 0 (0.3333/0.125/0/0)

Source

��

�s

��

�[��

�C

��

�n

��J

�C

Ref 0

name

Kumi

Harada.
Check

in,

please.

Ref 1

Kumi

Harada.
Check

in,

please.

Ref 2

Kumi

Harada.
I

would

check

please.

Ref 3

name

Kumi

Harada.
I

would

check

in,

please.

Ref 4

name

Kumi

Harada.
I'd

check

in,

please.

Ref 5

name

Kumi

Harada

and

I'd

check

in,

please.

Output 0

name

kumiko

Harada.

would

stay.

N-grams

My	name	is	kumiko	Harada.	I	would	like	to	stay.
My	name	is		Harada.	I	would	like	to
My name						would like
My name is						would like to
	name is						like to

Output 1

stay

N-grams

stay

Output 2

name

Kumiko

Harada.

would

stay.

N-grams

My	name	is	Kumiko	Harada.	I	would	like	to	stay.
My	name	is		Harada.	I	would	like	to
My name						would like
My name is						would like to
	name is						like to

Output 3

call

original

farmland

long

the

United

States.

want

accomodation.

N-grams

I	call	original	farmland	long	the	United	States.	I	want	accomodation.
I

Output 4

called

originally

Tian

Jiumei.

must

stay.

N-grams

I	am	called	originally	Tian	Jiumei.	I	must	stay.
I	am
I am

Sentence 415) BLEU: 0 (0.2857/0.1667/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.2857/0.1667/0/0)

Source

�ڭ�

��

�ж�

�Q

�j�s

�m

�F

�C

Ref 0

Someone

broke

into

our

room.

Ref 1

Someone

broke

into

our

room.

Ref 2

Somebody

forced

entry

into

our

room.

Ref 3

Someone

illegally

entered

our

room.

Ref 4

Somebody

broke

into

our

room.

Ref 5

Our

room

has

been

broken

into.

Output 0

Our

room

snatched

the

robber.

N-grams

Our	room	is	snatched	by	the	robber.
Our	room
Our room

Output 1

our

room

robbed

robber

the

N-grams

our	room	robbed	robber	by	the	.
our	room

Output 2

Our

room

was

robbed

robber.

N-grams

Our	room	was	robbed	robber.
Our	room
Our room

Output 3

Our

rooms

were

robbed

the

robber.

N-grams

Our	rooms	were	robbed	by	the	robber.
Our

Output 4

Our

room

snatched

the

robber.

N-grams

Our	room	is	snatched	by	the	robber.
Our	room
Our room

Sentence 416) BLEU: 0 (0.8462/0.3333/0.09091/0) ; 0 (0.7273/0.4/0.1111/0) ; 0 (0.8462/0.3333/0.09091/0) ; 0 (0.6364/0.3/0/0) ; 0 (0.6154/0.1667/0/0)

Source

��

�u��

�w�g

��

�E�~

�F

��~

��

�

��

�P��

�C

Ref 0

I've

been

with

our

Company

for

nine

years

and

I'm

entitled

four

weeks

paid

leave

this

year.

Ref 1

For

nine

years

have

been

with

our

Company

and

deserve

four

weeks

paid

leave

this

year.

Ref 2

Since

have

been

working

for

this

company

for

nine

years,

this

year

holiday

allowance

should

four

weeks.

Ref 3

have

been

working

our

Company

for

nine

years

allowed

four

weeks

paid

leave

this

year.

Ref 4

I've

been

with

our

Company

nine

years

and

get

four

weeks

paid

leave

this

year.

Ref 5

I've

been

with

our

Company

for

nine

years

now

and

I'm

entitled

four

weeks

paid

time

off

this

year.

Output 0

already

have

nine

years

seniority

have

four

weeks

this

year.

N-grams

already

have

nine

years

seniority

have

four

weeks

this

year.

have

nine

years

four

weeks

this

year.

nine years

four weeks

this year.

four weeks of

weeks of

Output 1

already

have

nine

years

seniority

four

weeks

this

year

N-grams

already	have	nine	years	seniority	four	weeks	this	year	my	.
	have	nine	years		four	weeks	this	year	my
		nine years			four weeks		this year
							this year my
								year my

Output 2

already

have

nine

years

seniority

have

four

weeks

this

year.

N-grams

already

have

nine

years

seniority

have

four

weeks

this

year.

have

nine

years

four

weeks

this

year.

nine years

four weeks

this year.

four weeks of

weeks of

Output 3

work

age

already

nine

years

have

four

weeks

this

year.

N-grams

My	work	age	already	nine	years	have	four	weeks	this	year.
				nine	years	have	four	weeks	this	year.
				nine years			four weeks		this year.

Output 4

job

seniority

already

had

nine

year

this

year

have

four

weeks.

N-grams

job

seniority

already

had

nine

year

this

year

have

four

weeks.

nine

year

this

have

four

weeks.

this year

four weeks.

Sentence 417) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0)

Source

�Z��

��

�F

�C

Ref 0

The

toilet

doesn't

flush.

Ref 1

The

toilet

doesn't

flush.

Ref 2

The

toilet

does

not

flush.

Ref 3

The

toilet

isn't

working.

Ref 4

The

toilet

doesn't

flush.

Ref 5

The

toilet

won't

flush.

Output 0

The

toilet

blocked

up.

N-grams

The	toilet	blocked	up.
The	toilet
The toilet

Output 1

the

toilet

N-grams

the	toilet	up	.
	toilet

Output 2

Plugging

the

toilet.

N-grams

Plugging

the

toilet.

Output 3

The

toilet

blocked

up.

N-grams

The	toilet	blocked	up.
The	toilet
The toilet

Output 4

The

restroom

stopped

up.

N-grams

The	restroom	stopped	up.
The

Sentence 418) BLEU: 0 (0.3333/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0)

Source

��

�n

��

��y

��

�H

Ref 0

What

the

best

way

shoot?

Ref 1

Which

the

best

way

shoot?

Ref 2

What

the

optimal

way

shoot?

Ref 3

Which

the

most

accurate

way

aim?

Ref 4

What's

the

best

way

shoot?

Ref 5

Can

you

tell

the

best

way

shoot?

Output 0

The

best

shot

what?

N-grams

The	best	shot	to	do	what?
	best		to

Output 1

best

how

should

ball

N-grams

best	do	how	should	ball	?
best

Output 2

The

best

shot

what?

N-grams

The	best	shot	to	do	what?
	best		to

Output 3

How

should

bestly

hitting

ball

with

racket

does?

N-grams

How

should

bestly

hitting

ball

with

racket

does?

Output 4

How

best

hits

ball

should

do?

N-grams

How	best	hits	a	ball	should	do?
	best

Sentence 419) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.75/0.6667/0.5/0)

Source

��

�o��

�C

Ref 0

Step

the

accelerator.

Ref 1

Speed

up.

Ref 2

Push

the

gas.

Ref 3

Hit

the

gas.

Ref 4

faster.

Ref 5

Press

down

hard

the

accelerator.

Output 0

Steps

the

accelerator.

N-grams

Steps	on	the	accelerator.
	on	the	accelerator.
	on the
	on the accelerator.
		the accelerator.

Output 1

accelerator

N-grams

accelerator

Output 2

踩油門.

N-grams

踩油門.

Output 3

Trample

accelerator.

N-grams

Trample	accelerator.
	accelerator.

Output 4

Steps

the

accelerator.

N-grams

Steps	on	the	accelerator.
	on	the	accelerator.
	on the
	on the accelerator.
		the accelerator.

Sentence 420) BLEU: 0 (0.2/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.2222/0/0/0)

Source

�w��{

�C

�w��

�z

��

�ϻ��]

�C

Ref 0

Good

morning,

sir.
Welcome

AAA

Hotel.

Ref 1

Good

morning,

sir.
Welcome

AAA

Hotel.

Ref 2

Good

morning,

sir.
Welcome

the

AAA

Hotel.

Ref 3

Good

morning,

sir.
Welcome

AAA

Hotel.

Ref 4

Good

morning,

sir.
Welcome

AAA

Hotel.

Ref 5

Good

morning

and

welcome

AAA

Hotel,

sir.

Output 0

Welcome.

Welcome

guesthouse.

N-grams

Welcome.	Welcome	to	a	guesthouse.
		to

Output 1

welcome

guesthouse

you

N-grams

welcome	welcome	to	a	guesthouse	you	.
welcome	welcome to
		to

Output 2

Welcome.

Welcome

guesthouse.

N-grams

Welcome.	Welcome	to	A	guesthouse.
		to

Output 3

Welcome.

Welcome

you

��

guest

house.

N-grams

Welcome.	Welcome	you	to	��	guest	house.
			to

Output 4

Welcome

the

presence.

Welcome

you

come

guesthouse.

N-grams

Welcome	the	presence.	Welcome	you	to	come	a	guesthouse.
	the				to

Sentence 421) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.6/0.5/0.3333/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.2/0/0)

Source

�b

�o��

�Y

�٬O

�a��

�H

Ref 0

For

here

go?

Ref 1

For

here

take

out?

Ref 2

Eat

take

away?

Ref 3

Will

you

have

here

take

out?

Ref 4

stay

go?

Ref 5

that

for

here

go?

Output 0

Eat

here

go?

N-grams

Eat	here	or	to	go?
Eat	here	or	to	go?
	here or		to go?
	here or to
	here or to go?
		or to
		or to go?

Output 1

eat

here

N-grams

eat	here	or	to	?
	here	or	to
	here or
	here or to
		or to

Output 2

Eat

here

go?

N-grams

Eat	here	or	to	go?
Eat	here	or	to	go?
	here or		to go?
	here or to
	here or to go?
		or to
		or to go?

Output 3

Eat

still

keep

taking

here?

N-grams

Eat	to	still	keep	taking	here?
Eat	to

Output 4

Eats

here

carries

off?

N-grams

Eats	in	here	or	carries	off?
	in	here	or
		here or

Sentence 422) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.75/0.3333/0/0)

Source

��

�Q

�n

�o��

�C

Ref 0

I'd

receipt,

please.

Ref 1

Please

give

receipt.

Ref 2

would

proof

payment,

please.

Ref 3

want

receipt,

please.

Ref 4

would

receipt,

please.

Ref 5

May

have

receipt,

please?

Output 0

want

the

receipt.

N-grams

I	want	the	receipt.
I	want		receipt.
I want

Output 1

want

invoice

N-grams

i	want	invoice	.
	want

Output 2

want

invoice.

N-grams

I	want	to	invoice.
I	want
I want

Output 3

want

invoice.

N-grams

I	want	invoice.
I	want
I want

Output 4

want

the

receipt.

N-grams

I	want	the	receipt.
I	want		receipt.
I want

Sentence 423) BLEU: 0 (0.09091/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.09091/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0)

Source

�o

��

�ڤh

�L

��

�H

Ref 0

Does

this

bus

Fifth

Avenue?

Ref 1

Does

this

bus

Fifth

Avenue?

Ref 2

Does

this

bus

pass

through

Fifth

Avenue?

Ref 3

Will

this

bus

stop

Fifth

Avenue?

Ref 4

Will

this

bus

get

Fifth

Avenue?

Ref 5

Does

this

bus

Fifth

Avenue?

Output 0

The

purpose

his

bus

the

5th

street

off

it?

N-grams

The	purpose	of	his	bus	on	the	5th	street	off	it?
				bus

Output 1

bus

street

this

N-grams

bus	street	this	?
bus		this

Output 2

The

purpose

his

bus

the

5th

Street

off

it?

N-grams

The	purpose	of	his	bus	on	the	5th	Street	off	it?
				bus

Output 3

This

bus

leads

No.5

street?

N-grams

This	bus	leads	No.5	street?
	bus

Output 4

This

bus

fifth

street?

N-grams

This	bus	fifth	street?
	bus

Sentence 424) BLEU: 0.5373 (0.7/0.5556/0.5/0.4286) ; 0 (0.4545/0.2/0.1111/0) ; 0.5373 (0.7/0.5556/0.5/0.4286) ; 0.3672 (0.5455/0.4/0.3333/0.25) ; 0.4172 (0.7273/0.5/0.3333/0.25)

Source

�q

�i�h�y

��

�ì�

��

�h��

��

�H

Ref 0

How

much

from

Boston

New

York

boat?

Ref 1

How

much

does

cost

from

Boston

New

York

boat?

Ref 2

What

the

fare

from

Boston

New

York

boat?

Ref 3

How

much

does

cost

from

Boston

New

York

via

boat?

Ref 4

How

much

does

cost

boat

from

Boston

New

York?

Ref 5

How

much

from

Boston

New

York

boat?

Output 0

boat

from

Boston

New

York

how

much

money?

N-grams

By	boat	from	Boston	to	New	York	how	much	money?
	boat	from	Boston	to	New	York		much
	boat from		Boston to		New York
	boat from Boston			to New
	boat from Boston to
		from Boston		to New York
		from Boston to
		from Boston to New
			Boston to New
			Boston to New York

Output 1

boat

from

boston

new

york

how

much

money

N-grams

by	boat	from	boston	to	new	york	how	much	money	?
by	boat	from		to				much
by boat
by boat from
	boat from

Output 2

boat

from

Boston

New

York

how

much

money?

N-grams

By	boat	from	Boston	to	New	York	how	much	money?
	boat	from	Boston	to	New	York		much
	boat from		Boston to		New York
	boat from Boston			to New
	boat from Boston to
		from Boston		to New York
		from Boston to
		from Boston to New
			Boston to New
			Boston to New York

Output 3

Take

ship

from

Boston

New

York

how

much

N-grams

Take	a	ship	from	Boston	to	New	York	how	much	?
			from	Boston	to	New	York		much
			from Boston		to New
			from Boston to			New York
			from Boston to New
				Boston to
				Boston to New
				Boston to New York
					to New York

Output 4

Travels

boat

how

much

money

from

Boston

New

York?

N-grams

Travels	by	boat	how	much	money	from	Boston	to	New	York?
	by	boat		much		from	Boston	to	New	York?
	by boat					from Boston		to New
						from Boston to			New York?
						from Boston to New
							Boston to
							Boston to New
							Boston to New York?
								to New York?

Sentence 425) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�Y�w

�C

Ref 0

feel

dizzy.

Ref 1

feeling

dizzy.

Ref 2

feel

faint.

Ref 3

dizzy.

Ref 4

I'm

dizzy.

Ref 5

I'm

feeling

dizzy.

Output 0

Dizzy.

N-grams

Dizzy.

Output 1

dizziness

N-grams

dizziness

Output 2

Dizziness.

N-grams

Dizziness.

Output 3

Dizzy.

N-grams

Dizzy.

Output 4

Dizziness.

N-grams

Dizziness.

Sentence 426) BLEU: 0 (0.375/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�v��

�K��

��

�n

��

�H

Ref 0

want

some

medicine

good

for

constipation.

Ref 1

would

get

some

good

constipation

medicine.

Ref 2

would

some

laxative.

Ref 3

would

laxative.

Ref 4

want

some

medicine

help

with

constipation.

Ref 5

want

some

medicine

good

for

constipation.

Output 0

The

treatment

constipation

has

good

medicine?

N-grams

The	treatment	of	constipation	has	a	good	medicine?
			constipation		a	good

Output 1

the

treatment

constipation

has

good

medicine

N-grams

the	treatment	of	constipation	has	good	medicine	?
			constipation		good	medicine

Output 2

The

treatment

constipation

has

good

medicine?

N-grams

The	treatment	of	constipation	has	a	good	medicine?
			constipation		a	good

Output 3

there

the

good

medicine

treatment

constipation?

N-grams

Is	there	the	good	medicine	of	treatment	constipation?
			good	medicine

Output 4

Has

the

treatment

constipation

good

medicine?

N-grams

Has	the	treatment	constipation	good	medicine?
			constipation	good

Sentence 427) BLEU: 0 (0.3333/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.3333/0/0/0)

Source

��

�O��

��

�a��

��

�H

Ref 0

Where

the

cloakroom?

Ref 1

Where's

the

cloakroom?

Ref 2

there

cloakroom?

Ref 3

Could

you

tell

where

can

check

coat?

Ref 4

Where's

the

coatroom?

Ref 5

Where

the

cloakroom?

Output 0

Has

can

take

care

the

baggage

the

place?

N-grams

Has	can	take	care	of	the	baggage	the	place?
	can				the

Output 1

has

can

place

the

baggage

N-grams

has	of	can	place	the	baggage	?
		can		the

Output 2

Has

custody

luggage

can

place

it?

N-grams

Has	custody	of	luggage	can	place	it?
				can

Output 3

there

the

place

that

can

maintain

baggage?

N-grams

Is	there	the	place	that	can	maintain	baggage?
Is	there	the			can
Is there

Output 4

Has

can

take

care

the

baggage

the

place?

N-grams

Has	can	take	care	of	the	baggage	the	place?
	can				the

Sentence 428) BLEU: 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6667/0.5/0/0) ; 0 (0.6667/0.5/0/0)

Source

�h��

��

�H

Ref 0

How

much

it?

Ref 1

How

much

does

cost?

Ref 2

How

much

it?

Ref 3

What

does

cost?

Ref 4

How

much

it?

Ref 5

How

much

it?

Output 0

How

much

it?

N-grams

How	much	is	it?
How	much	is	it?
How much		is it?
How much is
How much is it?
	much is
	much is it?

Output 1

how

much

N-grams

how	much	?
	much

Output 2

How

much

it?

N-grams

How	much	is	it?
How	much	is	it?
How much		is it?
How much is
How much is it?
	much is
	much is it?

Output 3

How

much

N-grams

How	much	?
How	much
How much

Output 4

How

much

money?

N-grams

How	much	money?
How	much
How much

Sentence 429) BLEU: 0 (0.3636/0.1/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.3636/0.1/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2857/0.1667/0/0)

Source

��

�H��

�i�H

��

�n

��

�H

Ref 0

I'm

hurry,

can't

you

within

two

days?

Ref 1

rush,

couldn't

you

within

two

days?

Ref 2

I'm

rush,

can

you

finish

couple

days?

Ref 3

I'm

rush,

could

you

get

done

two

days?

Ref 4

I'm

hurry,

couldn't

you

within

two

days?

Ref 5

I'm

hurry,

can't

you

get

done

within

two

days?

Output 0

Very

eager

good

job

within

two

days

it?

N-grams

Very	eager	to	do	a	good	job	within	two	days	it?
			do	a			within	two
							within two

Output 1

very

within

two

days

N-grams

very	do	within	two	days	?
	do	within	two
		within two

Output 2

Very

eager

good

job

within

two

days

it?

N-grams

Very	eager	to	do	a	good	job	within	two	days	it?
			do	a			within	two
							within two

Output 3

Very

nasty

two

days

can

like?

N-grams

Very	nasty	two	days	in	can	do	like?
		two		in	can	do

Output 4

Very

anxious

within

two

days

may

do?

N-grams

Very	anxious	within	two	days	may	do?
		within	two
		within two

Sentence 430) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0.25/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (1/0.6667/0.5/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�@�U

��

�B��

��

�H

Ref 0

Can

look

for

friend?

Ref 1

Could

look

for

friend?

Ref 2

May

look

for

mate?

Ref 3

May

try

find

friend?

Ref 4

May

look

for

friend?

Ref 5

you

mind

look

for

friend?

Output 0

find

friend?

N-grams

To	find	my	friend?
	find	my	friend?
	find my
	find my friend?
		my friend?

Output 1

find

friend

can

N-grams

find	my	friend	can	?
find	my
find my

Output 2

find

friend?

N-grams

To	find	my	friend?
	find	my	friend?
	find my
	find my friend?
		my friend?

Output 3

Can

find

friend?

N-grams

Can	find	my	friend?
Can	find	my	friend?
	find my
	find my friend?
		my friend?

Output 4

Can

look

for

the

friend

mine?

N-grams

Can	look	for	the	friend	of	mine?
Can	look	for
	look for

Sentence 431) BLEU: 0 (1/0.6667/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.5/0/0/0) ; 0 (1/0.6667/0/0) ; 0 (0.5/0.3333/0/0)

Source

��

��y��

��

�H

Ref 0

you

have

tennis

court?

Ref 1

there

tennis

court?

Ref 2

Have

you

got

tennis

court?

Ref 3

you

have

tennis

court?

Ref 4

you

have

tennis

court?

Ref 5

you

have

tennis

court

available

Output 0

there

tennis

court?

N-grams

Is	there	tennis	court?
Is	there	tennis	court?
Is there		tennis court?

Output 1

tennis

court

N-grams

tennis	court	?
tennis	court
tennis court

Output 2

You

have

tennis

courts?

N-grams

You	have	tennis	courts?
	have	tennis

Output 3

there

tennis

court?

N-grams

Is	there	tennis	court?
Is	there	tennis	court?
Is there		tennis court?

Output 4

Has

the

tennis

court?

N-grams

Has	the	tennis	court?
		tennis	court?
		tennis court?

Sentence 432) BLEU: 0 (0.3333/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (1/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0)

Source

�i�H

�o�e

�q�l

�l��

��

�H

Ref 0

Can

email?

Ref 1

Could

email?

Ref 2

Can

send

email?

Ref 3

available?

Ref 4

Can

use

email?

Ref 5

Can

have

access

email?

Output 0

all

right

send

out

Electronics

mail?

N-grams

Is	it	all	right	to	send	out	Electronics	mail?
Is				to	send

Output 1

send

N-grams

send	email	?
send	email

Output 2

Can

send

email?

N-grams

Can	send	email?
Can	send	email?

Output 3

all

right

send

out

electronics

mail?

N-grams

Is	it	all	right	to	send	out	electronics	mail?
Is				to	send

Output 4

May

transmit

the

email?

N-grams

May	transmit	the	email?
			email?

Sentence 433) BLEU: 0 (0.4286/0.1667/0/0) ; 0 (0.7143/0.1667/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.4/0/0/0) ; 0 (0.625/0.2857/0/0)

Source

�q

�c�l

��

�X��

��

�w�g

�a

�F

�C

Ref 0

This

was

broken

when

took

out

the

box.

Ref 1

This

was

broken

when

removed

from

the

box.

Ref 2

was

busted

when

extracted

from

the

box.

Ref 3

This

was

already

damaged

when

removed

from

the

box.

Ref 4

This

was

broken

right

out

the

box.

Ref 5

When

took

this

out

the

box,

was

already

broken.

Output 0

Out

from

the

box

has

been

broken.

N-grams

Out	from	the	box	has	been	broken.
	from	the				broken.
	from the

Output 1

out

from

the

box

broken

already

N-grams

out	from	the	box	broken	already	.
out	from	the		broken	already
	from the

Output 2

Out

from

the

box

has

been

broken.

N-grams

Out	from	the	box	has	been	broken.
	from	the				broken.
	from the

Output 3

From

the

box

taking

out

have

already

broken

down.

N-grams

From	the	box	in	taking	out	have	already	broken	down.
	the				out		already	broken

Output 4

Takes

from

the

box

when

was

already

bad.

N-grams

Takes	from	the	box	when	was	already	bad.
	from	the		when	was	already
	from the				was already

Sentence 434) BLEU: 0 (0.1429/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�L

�n

��

��t

��

�F

��

�H

Ref 0

Have

you

seen

any

good

shows?

Ref 1

Did

you

see

any

good

shows?

Ref 2

Have

you

been

any

good

shows?

Ref 3

Did

you

see

any

entertaining

shows?

Ref 4

Have

you

seen

any

good

performances?

Ref 5

Have

you

seen

any

good

shows?

Output 0

What

are

the

best

performances

seen

it?

N-grams

What	are	the	best	performances	seen	it?
					seen

Output 1

what

the

good

performance

N-grams

what	the	good	performance	?
		good

Output 2

What

are

the

best

performances

seen

it?

N-grams

What	are	the	best	performances	seen	it?
					seen

Output 3

Once

saw

good

performance

what

of?

N-grams

Once	saw	good	performance	what	of?
		good

Output 4

What

has

watched

the

good

performance?

N-grams

What	has	watched	the	good	performance?
				good

Sentence 435) BLEU: 0 (0.2727/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.1667/0/0/0)

Source

�ȹC

�ݸ߳B

�b

��

�H

Ref 0

Information

center,

please.

Ref 1

The

information

center,

please.

Ref 2

Information

center,

please.

Ref 3

I'd

the

information

center,

please.

Ref 4

Direct

the

information

center,

please.

Ref 5

Information

center,

please.

Output 0

Where

does

the

tour

ask

inquire

placed

in?

N-grams

Where	does	the	tour	ask	to	inquire	to	be	placed	in?
		the			to

Output 1

where

does

the

inquire

N-grams

in	where	does	the	inquire	?
			the

Output 2

Tourist

information

where?

N-grams

Tourist	information	in	where?
	information

Output 3

Where

does

the

tour

ask

inquire

placed

in?

N-grams

Where	does	the	tour	ask	to	inquire	to	be	placed	in?
		the			to

Output 4

Where

does

the

traveling

inquire

occupies?

N-grams

Where	does	the	traveling	inquire	occupies?
		the

Sentence 436) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0)

Source

��

�ݭn

��

�C

Ref 0

need

today.

Ref 1

require

today.

Ref 2

need

today.

Ref 3

have

today.

Ref 4

need

today.

Ref 5

need

today.

Output 0

That

required

today.

N-grams

That	required	of	today.
			today.

Output 1

that

today

N-grams

that

today

Output 2

That

required

today.

N-grams

That	required	of	today.
			today.

Output 3

Today

inside

need

that.

N-grams

Today	inside	need	that.
		need

Output 4

Today

within

needs

that.

N-grams

Today

within

needs

that.

Sentence 437) BLEU: 0 (0.3636/0.1/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.3571/0.07692/0/0) ; 0 (0.3636/0.1/0/0)

Source

�}��

�f�L

��

�q

�X

��

��x

�o��

�H

Ref 0

Which

track

does

the

Berlin

train

leave

from?

Ref 1

What

track

does

the

train

Berlin

depart

from?

Ref 2

From

which

platform

does

the

train

for

Berlin

depart?

Ref 3

From

which

track

does

the

Berlin

train

leave?

Ref 4

From

which

platform

does

the

Berlin

train

leave?

Ref 5

From

which

track

does

the

Berlin

train

depart?

Output 0

How

many

platforms

leaves

for

Berlin's

train

start

out

from?

N-grams

How	many	platforms	leaves	for	Berlin's	train	to	start	out	from?
				for		train	to			from?
						train to

Output 1

train

from

start

for

berlin

N-grams

train	from	start	for	berlin	to	?
train			for		to

Output 2

Berlin-bound

train

from

platform

No.

few

start?

N-grams

Berlin-bound	train	from	platform	No.	few	start?
	train		platform

Output 3

Leave

for

the

train

Berlin

deliver

car

from

several

number

websites?

N-grams

Leave

for

the

train

Berlin

deliver

car

from

several

number

websites?

for

the

train

Berlin

the train

Output 4

How

many

platforms

leaves

for

Berlin's

train

start

out

from?

N-grams

How	many	platforms	leaves	for	Berlin's	train	to	start	out	from?
				for		train	to			from?
						train to

Sentence 438) BLEU: 0 (0.2857/0.1667/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.25/0.1429/0/0) ; 0 (0.5/0.3333/0/0)

Source

�q

��

�_��

�H

Ref 0

Which

airport

leave

from?

Ref 1

Which

airport

depart

from?

Ref 2

From

which

airport

does

flight

depart?

Ref 3

From

which

airport

leave?

Ref 4

Which

airport

leave

from?

Ref 5

From

which

airport

depart?

Output 0

Which

airport

did

you

take

off

it?

N-grams

Which	airport	did	you	take	off	it?
Which	airport
Which airport

Output 1

from

which

airport

N-grams

from	which	airport	?
	which	airport
	which airport

Output 2

From

which

airport?

N-grams

From	which	airport?
From	which
From which

Output 3

Which

airport

did

you

take

off

N-grams

Which	airport	did	you	take	off	it	?
Which	airport
Which airport

Output 4

From

which

field

takeoff?

N-grams

From	which	field	takeoff?
From	which
From which

Sentence 439) BLEU: 0 (0.2222/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.09091/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

��R

�I��

�쩳

��

�F

�H

Ref 0

Calm

down.
What's

the

matter?

Ref 1

Relax.
What

seems

the

problem?

Ref 2

Relax.
What's

the

problem?

Ref 3

Relax.
What

the

problem?

Ref 4

Calm

down.
What's

wrong?

Ref 5

Please,

calm

down.
What's

the

problem?

Output 0

Hey

how

the

end

some

the

sedation?

N-grams

Hey	how	in	the	end	some	of	the	sedation?
			the

Output 1

how

the

town

N-grams

how	in	the	town	?
		the

Output 2

Hey

how

the

end

some

the

sedation?

N-grams

Hey	how	in	the	end	some	of	the	sedation?
			the

Output 3

little

bit

quiet

son

the

hello

town

how

exactly?

N-grams

A	little	bit	quiet	son	in	the	hello	town	how	exactly?
						the

Output 4

How

fed

the

town

dead

center?

N-grams

How	fed	the	town	dead	center?
		the

Sentence 440) BLEU: 0 (0.6/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.2/0/0/0)

Source

�b

��

�R

��

�H

Ref 0

Where

can

get

ticket?

Ref 1

Where

can

obtain

ticket?

Ref 2

Where

can

buy

ticket

from?

Ref 3

Where

can

purchase

ticket?

Ref 4

Where

can

pick

ticket?

Ref 5

Where

can

buy

ticket?

Output 0

Where

did

you

buy

ticket?

N-grams

Where	did	you	buy	ticket?
Where			buy	ticket?

Output 1

where

buy

ticket

N-grams

where	buy	ticket	?
	buy	ticket

Output 2

Where

buy

tickets?

N-grams

Where	to	buy	tickets?
Where		buy

Output 3

Where

did

you

buy

ticket?

N-grams

Where	did	you	buy	ticket?
Where			buy	ticket?

Output 4

Buys

the

ticket

where?

N-grams

Buys	the	ticket	in	where?
		ticket

Sentence 441) BLEU: 0 (0.375/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.3846/0.1667/0/0) ; 0.3448 (0.5833/0.3636/0.3/0.2222)

Source

��

�L�l

�b

��ȥx

�I�b

�C

Ref 0

Pick

the

tray

and

pay

the

cashier,

please.

Ref 1

Pick

the

tray

and

pay

the

cash

please.

Ref 2

Take

the

serving

dish

and

pay

the

till,

please.

Ref 3

Please

take

the

tray

the

cashier

and

pay.

Ref 4

Take

the

tray

and

pay

the

cashier,

please.

Ref 5

Take

the

tray

and

pay

the

cashier,

please.

Output 0

Please

pay

with

plate

the

checkout.

N-grams

Please	pay	with	a	plate	in	the	checkout.
Please	pay					the

Output 1

please

pay

plate

the

take

silver

bill

N-grams

please	pay	a	plate	the	take	silver	to	bill	.
	pay			the	take		to

Output 2

Please

pay

with

plate

the

checkout.

N-grams

Please	pay	with	a	plate	in	the	checkout.
Please	pay					the

Output 3

Please

take

plate

accepting

silver

set

pay

the

bill.

N-grams

Please

take

plate

accepting

silver

set

pay

the

bill.

Please

take

pay

the

Please take

pay the

Output 4

Please

take

the

tray

receive

silver

Taiwan

pay

bill.

N-grams

Please	take	the	tray	to	receive	silver	Taiwan	to	pay	a	bill.
Please	take	the	tray	to					pay
Please take		the tray
Please take the			tray to
Please take the tray
	take the
	take the tray
	take the tray to
		the tray to

Sentence 442) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

see.
Thank

you.

Ref 1

I	understand. Thanks.

Ref 2

Okay.
Thanks.

Ref 3

Understood.
Thanks.

Ref 4

I	see. Thanks.

Ref 5

understand.
Thank

you.

Output 0

Thanks.

N-grams

Thanks.

Output 1

N-grams

Output 2

謝謝.

N-grams

謝謝.

Output 3

Thank.

N-grams

Thank.

Output 4

Thanks.

N-grams

Thanks.

Sentence 443) BLEU: 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�o��

��

��I��

�C

Ref 0

I'm

not

sure

this

would

appropriate.

Ref 1

doubt

this

would

appropriate.

Ref 2

I'm

unsure

this

would

right.

Ref 3

don't

know

this

proper.

Ref 4

I'm

not

sure

whether

this

would

appropriate.

Ref 5

I'm

not

sure

this

would

suitable.

Output 0

This

little.

N-grams

This

little.

Output 1

this

little

N-grams

a	this	little	.
	this

Output 2

Well

bit.

N-grams

Well

bit.

Output 3

This

have

little

son.

N-grams

This

have

little

son.

Output 4

This

little.

N-grams

This

little.

Sentence 444) BLEU: 0 (0.4/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0)

Source

��

�F

�C

Ref 0

Keep

the

change.

Ref 1

Keep

the

change.

Ref 2

Keep

the

rest.

Ref 3

You

can

have

the

change.

Ref 4

Keep

the

change.

Ref 5

Keep

the

change.

Output 0

not

have

the

money.

N-grams

Do	not	have	the	money.
		have	the
		have the

Output 1

not

money

need

change

N-grams

not

money

need

change

Output 2

not

have

the

money.

N-grams

Do	not	have	the	money.
		have	the
		have the

Output 3

Don't

need

return

change.

N-grams

Don't	need	to	return	change.
				change.

Output 4

Did

not

need

give

change

get

money.

N-grams

Did

not

need

give

change

get

money.

Sentence 445) BLEU: 0 (0/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0)

Source

�H�e

��

�L

�o��

��

�H

Ref 0

Have

you

ever

been

here

before?

Ref 1

Have

you

ever

been

here

before

now?

Ref 2

Have

you

ever

visited

here

previously?

Ref 3

Have

you

been

here

previously?

Ref 4

Have

you

been

here

before?

Ref 5

Have

you

ever

been

here

prior

this?

Output 0

Before

has

come

here?

N-grams

Before

has

come

here?

Output 1

here

before

N-grams

here	before	?
here	before
here before

Output 2

Here

before

you?

N-grams

Here	before	you?
	before

Output 3

Once

came

here

before?

N-grams

Once	came	here	before?
		here	before?
		here before?

Output 4

Before

has

come

here?

N-grams

Before

has

come

here?

Sentence 446) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.375/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.4/0.1111/0/0) ; 0 (0.7143/0/0/0)

Source

��

�o��

��y

�l�H

��

�饻

��

�H

Ref 0

Would

you

able

mail

these

Japan?

Ref 1

possible

for

you

mail

these

Japan?

Ref 2

Can

you

post

these

Japan?

Ref 3

Could

you

post

these

Japan?

Ref 4

Could

you

mail

these

Japan?

Ref 5

Would

possible

for

you

mail

these

Japan?

Output 0

Can

put

these

books

sent

Japan?

N-grams

Can	I	put	these	books	sent	to	Japan?
Can			these			to	Japan?
						to Japan?

Output 1

can

these

books

japan

for

N-grams

can	these	books	to	japan	for	me	?
	these		to		for

Output 2

Can

put

these

books

sent

Japan?

N-grams

Can	I	put	these	books	sent	to	Japan?
Can			these			to	Japan?
						to Japan?

Output 3

Does

the

ability

mail

these

books

Japan

for

me?

N-grams

Does	the	ability	mail	these	books	to	Japan	for	me?
			mail	these		to		for
			mail these

Output 4

Can

for

these

book

post

Japan?

N-grams

Can	for	me	these	book	post	Japan?
Can	for		these		post	Japan?

Sentence 447) BLEU: 0 (0.3333/0.2/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0/0/0/0)

Source

��

�A

��

�I

�@��

�C

Ref 0

Some

coffee,

please.

Ref 1

bit

coffee,

please.

Ref 2

coffee,

please.

Ref 3

I'll

have

another

cup

coffee,

please.

Ref 4

Some

coffee,

please.

Ref 5

May

have

some

coffee,

please?

Output 0

Please

give

some

coffee.

N-grams

Please	give	me	some	more	coffee.
			some	more
			some more

Output 1

please

come

the

coffee

N-grams

please

come

the

coffee

Output 2

Please

come

back

the

coffee.

N-grams

Please

come

back

the

coffee.

Output 3

Please

give

some

coffee.

N-grams

Please	give	me	some	more	coffee.
			some	more
			some more

Output 4

Please

again

come

select

the

coffee.

N-grams

Please

again

come

select

the

coffee.

Sentence 448) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.4286/0.3333/0.2/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.6/0.5/0.3333/0) ; 0.5081 (0.6667/0.6/0.5/0.3333)

Source

��

�A

�h

�C

Ref 0

No.
I

won't

with

you.

Ref 1

No.
I

will

not

accompany

you.

Ref 2

No.
I

won't

with

you.

Ref 3

No.
I

will

not

with

you.

Ref 4

No.
I

won't

with

you.

Ref 5

No.
I

won't

with

you.

Output 0

don't

with

you.

N-grams

I	don't	go	with	you.
		go	with	you.
		go with
		go with you.
			with you.

Output 1

not

with

you

N-grams

i	do	not	go	with	you	.
		not	go	with
		not go
		not go with
			go with

Output 2

not

with

you.

N-grams

I	do	not	go	with	you.
		not	go	with	you.
		not go		with you.
		not go with
		not go with you.
			go with
			go with you.

Output 3

don't

with

you.

N-grams

I	don't	go	with	you.
		go	with	you.
		go with
		go with you.
			with you.

Output 4

not

with

you.

N-grams

I	do	not	go	with	you.
		not	go	with	you.
		not go		with you.
		not go with
		not go with you.
			go with
			go with you.

Sentence 449) BLEU: 0 (0.3333/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.5/0.2222/0.125/0) ; 0 (0.1111/0/0/0) ; 0 (0.3333/0/0/0)

Source

�n��

�C

�]�A

�

�b��

�@�@

�E

�Q

��

�C

Ref 0

comes

ninety-five

dollars

including

tax.

Ref 1

The

total

ninety-five

dollars

including

tax.

Ref 2

Including

tax,

the

total

ninety-five

dollars.

Ref 3

comes

ninety-five

dollars

tax

included.

Ref 4

comes

ninety-five

dollars

with

tax.

Ref 5

The

total

ninety-five

dollars

tax

included.

Output 0

Good.

Including

tax

altogether

nine

ten

five

dollars.

N-grams

Good.	Including	tax	altogether	nine	ten	five	US	dollars.
	Including	tax						dollars.

Output 1

including

dollars

tax

N-grams

including	a	95	us	dollars	tax	.
including				dollars	tax
				dollars tax

Output 2

好的.

Including

total

dollars

including

tax.

N-grams

好的.	Including	a	total	of	95	US	dollars	including	tax.
	Including		total				dollars	including	tax.
							dollars including
							dollars including tax.
								including tax.

Output 3

Okay.

Include

tax

inside

totally

USD

95.

N-grams

Okay.	Include	a	tax	at	inside	totally	USD	95.
			tax

Output 4

Good.

Including

tax

altogether

nine

ten

five

dollars.

N-grams

Good.	Including	tax	altogether	nine	ten	five	US	dollars.
	Including	tax						dollars.

Sentence 450) BLEU: 0 (0.375/0.2667/0.1429/0) ; 0 (0.4375/0.06667/0/0) ; 0 (0.375/0.2667/0.1429/0) ; 0 (0.3333/0.1176/0.0625/0) ; 0 (0.3529/0.125/0.06667/0)

Source

�O

�b

��]

�Y

��

�Q

�F

�C

�٬O

�b

�~��

��

�a��

�Y

�a

�C

Ref 0

It's

expensive

eat

the

hotel.
Let's

out

somewhere.

Ref 1

very

costly

eat

the

hotel.
Let's

somewhere

else.

Ref 2

Eating

the

hotel

costly.
Let's

somewhere

else.

Ref 3

very

costly

eat

the

hotel.
Let's

eat

somewhere

else.

Ref 4

expensive

eat

the

hotel.
Let's

out

someplace.

Ref 5

It's

expensive

eat

the

hotel.
Let's

somewhere

else.

Output 0

not

eat

the

hotel

too

expensive.

looking

for

place

eat

outside.

N-grams

not

eat

the

hotel

too

expensive.

looking

for

place

eat

outside.

eat

the

hotel

eat

eat at

the hotel

to eat

eat at the

at the

at the hotel

Output 1

not

eat

the

too

expensive

for

place

eat

outside

N-grams

not

eat

the

too

expensive

for

place

eat

outside

eat

the

expensive

eat

to eat

Output 2

not

eat

the

hotel

too

expensive.

looking

for

place

eat

outside.

N-grams

not

eat

the

hotel

too

expensive.

looking

for

place

eat

outside.

eat

the

hotel

eat

eat at

the hotel

to eat

eat at the

at the

at the hotel

Output 3

Doing

not

eat

the

guest

house

too

expensive.

outside

finding

place

eat.

N-grams

Doing

not

eat

the

guest

house

too

expensive.

outside

finding

place

eat.

eat

the

eat in

eat in the

in the

Output 4

not

eat

the

guesthouse

too

expensive.

Looks

for

place

outside

eat.

N-grams

not

eat

the

guesthouse

too

expensive.

Looks

for

place

outside

eat.

eat

the

eat in

eat in the

in the

Sentence 451) BLEU: 0 (0.375/0.2857/0.1667/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.375/0.2857/0.1667/0) ; 0 (0.2/0/0/0)

Source

�Q

�w�q

��H��

�C

Ref 0

I'd

reserve

double

room.

Ref 1

would

reserve

double

room.

Ref 2

would

book

double.

Ref 3

want

book

double

room.

Ref 4

I'd

reserve

double.

Ref 5

possible

reserve

double

room?

Output 0

Want

reserve

pair

Human

lifes.

N-grams

Want	to	reserve	a	pair	of	Human	lifes.
	to	reserve	a
	to reserve
	to reserve a
		reserve a

Output 1

N-grams

to	.
to

Output 2

Bookings

Double

Think.

N-grams

Bookings

Double

Think.

Output 3

Want

reserve

pair

human

lifes.

N-grams

Want	to	reserve	a	pair	of	human	lifes.
	to	reserve	a
	to reserve
	to reserve a
		reserve a

Output 4

Wants

order

two

person.

N-grams

Wants	to	order	two	person.
	to

Sentence 452) BLEU: 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0)

Source

��

�z

�Ȧ�

�r��

�C

Ref 0

Have

nice

trip.

Ref 1

Have

good

trip.

Ref 2

Enjoy

your

journey.

Ref 3

Have

good

journey.

Ref 4

Have

nice

trip.

Ref 5

Enjoy

your

trip.

Output 0

wish

you

pleasant

trip.

N-grams

I	wish	you	a	pleasant	trip.
			a		trip.

Output 1

wish

trip

your

N-grams

wish	trip	your	.
		your

Output 2

wish

you

pleasant

trip.

N-grams

I	wish	you	a	pleasant	trip.
			a		trip.

Output 3

Wish

your

trip

delectation.

N-grams

Wish	your	trip	delectation.
	your

Output 4

Wishes

your

enjoy

travel.

N-grams

Wishes	your	enjoy	travel.
	your

Sentence 453) BLEU: 0.6435 (0.8571/0.6667/0.6/0.5) ; 0 (0.7143/0.1667/0/0) ; 0.6435 (0.8571/0.6667/0.6/0.5) ; 0 (0.8571/0.3333/0/0) ; 0 (0.7143/0.1667/0/0)

Source

��

��g

�o

�i

��J

�n�O�d

�C

Ref 0

Please

fill

out

this

registration

card.

Ref 1

Fill

out

this

registration

card,

please.

Ref 2

Please

complete

this

check

card.

Ref 3

Please

complete

this

card

for

registration.

Ref 4

Please

fill

out

this

registration

card.

Ref 5

Please

fill

out

this

registration

card.

Output 0

Please

fill

out

this

registration

card

accommodation.

N-grams

Please	fill	out	this	registration	card	accommodation.
Please	fill	out	this	registration	card
Please fill		out this
Please fill out			this registration
Please fill out this
	fill out
	fill out this
	fill out this registration
		out this registration

Output 1

please

fill

this

registration

card

N-grams

please	fill	this	registration	card	in	.
	fill	this	registration	card	in
		this registration

Output 2

Please

fill

out

this

registration

card

accommodation.

N-grams

Please	fill	out	this	registration	card	accommodation.
Please	fill	out	this	registration	card
Please fill		out this
Please fill out			this registration
Please fill out this
	fill out
	fill out this
	fill out this registration
		out this registration

Output 3

Please

fill

this

accomodation

registration

card.

N-grams

Please	fill	in	this	accomodation	registration	card.
Please	fill	in	this		registration	card.
Please fill					registration card.

Output 4

Please

fill

this

lodging

card.

N-grams

Please	fill	in	this	lodging	register	card.
Please	fill	in	this			card.
Please fill

Sentence 454) BLEU: 0.6148 (0.7143/0.6667/0.6/0.5) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.5714/0.3333/0.2/0) ; 0.6148 (0.7143/0.6667/0.6/0.5) ; 0 (0.2857/0.1667/0/0)

Source

�z

�n

��

�@�U

��s

��

�H

Ref 0

Would

you

taste

the

wine?

Ref 1

you

want

taste

the

wine?

Ref 2

Would

you

savor

the

wine?

Ref 3

Would

you

taste

the

wine?

Ref 4

Would

you

taste

the

wine?

Ref 5

Would

you

sample

the

wine?

Output 0

you

want

taste

wine

first?

N-grams

Do	you	want	to	taste	wine	first?
Do	you	want	to	taste
Do you		want to
Do you want			to taste
Do you want to
	you want
	you want to
	you want to taste
		want to taste

Output 1

you

want

taste

wine

first

N-grams

you	want	to	taste	wine	first	?
you	want	to	taste
you want		to taste
you want to
you want to taste
	want to
	want to taste

Output 2

You

want

taste

wine

it?

N-grams

You	want	to	taste	wine	like	it?
	want	to	taste		like
	want to
	want to taste
		to taste

Output 3

you

want

taste

wine

first?

N-grams

Do	you	want	to	taste	wine	first?
Do	you	want	to	taste
Do you		want to
Do you want			to taste
Do you want to
	you want
	you want to
	you want to taste
		want to taste

Output 4

You

must

taste

the

grape

wine

first?

N-grams

You	must	taste	the	grape	wine	first?
		taste	the
		taste the

Sentence 455) BLEU: 0.239 (0.5385/0.3333/0.1818/0.1) ; 0 (0.4/0.2222/0.125/0) ; 0.239 (0.5385/0.3333/0.1818/0.1) ; 0 (0.4615/0.1667/0.09091/0) ; 0 (0.5455/0.2/0.1111/0)

Source

��

�Q

�R

��

�@��

��

�H

Ref 0

feel

vomiting

and

pain,

can

have

some

medicine,

please?

Ref 1

feel

throwing

and

pain,

could

you

give

some

medicine,

please?

Ref 2

feel

queasy

and

ache,

may

have

some

medicine,

please?

Ref 3

feel

throwing

and

I'm

pain,

could

you

please

give

some

medicine?

Ref 4

feel

throwing

and

pain,

can

have

some

medication,

please?

Ref 5

feel

need

vomit

and

I'm

pain,

can

have

some

medicine,

please?

Output 0

sick

very

difficult

subject

give

some

medicine?

N-grams

sick

very

difficult

subject

give

some

medicine?

give

some

medicine?

I am

give me

some medicine?

give me some

give me some medicine?

me some

me some medicine?

Output 1

very

give

some

want

medicines

N-grams

i	is	very	to	give	me	some	want	medicines	?
			to	give	me	some
				give me
				give me some
					me some

Output 2

sick

very

difficult

subject

give

some

medicine?

N-grams

sick

very

difficult

subject

give

some

medicine?

give

some

medicine?

I am

give me

some medicine?

give me some

give me some medicine?

me some

me some medicine?

Output 3

want

that

vomiting

very

suffered

give

some

medicines?

N-grams

want

that

vomiting

very

suffered

give

some

medicines?

vomiting

give

some

give me

give me some

me some

Output 4

want

spit

very

uncomfortably

can

give

some

medicines?

N-grams

I	want	to	spit	very	uncomfortably	can	give	me	some	medicines?
I		to				can	give	me	some
							give me
							give me some
								me some

Sentence 456) BLEU: 0 (0.5455/0.3/0/0) ; 0 (0.4545/0.1/0/0) ; 0 (0.5455/0.2/0/0) ; 0 (0.5/0.1333/0.07143/0) ; 0 (0.5455/0.3/0/0)

Source

��

�

��

��n

��

�w�q

�C

Ref 0

I'll

arrive

late,

but

keep

reservation,

please.

Ref 1

will

arriving

late,

but

please

keep

reservation.

Ref 2

going

late,

but

keep

booking,

please.

Ref 3

I'm

going

arrive

late,

but

hold

reservation,

please.

Ref 4

will

arriving

late,

but

hold

reservation,

please.

Ref 5

I'll

arriving

late,

but

please

hold

reservation.

Output 0

will

later

arrive,

but

please

not

cancel

reservation.

N-grams

I	will	later	arrive,	but	please	do	not	cancel	my	reservation.
I	will			but	please				my	reservation.
I will				but please					my reservation.

Output 1

will

later

but

please

not

cancel

N-grams

i	will	later	to	but	please	do	not	cancel	my	.
	will		to	but	please				my
				but please

Output 2

will

later

but

please

not

cancel

booking.

N-grams

I	will	later	to	but	please	do	not	cancel	my	booking.
I	will		to	but	please				my
I will				but please

Output 3

will

late

some

but

ask

and

don't

cancel

reserve.

N-grams

will

late

some

but

ask

and

don't

cancel

reserve.

will

but

I will

I will be

will be

Output 4

will

later

arrive,

but

please

not

cancel

reservation.

N-grams

I	will	later	arrive,	but	please	do	not	cancel	my	reservation.
I	will			but	please				my	reservation.
I will				but please					my reservation.

Sentence 457) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�H�Υd

��

�H

Ref 0

you

take

credit

cards?

Ref 1

you

credit

cards?

Ref 2

Can

pay

credit

card?

Ref 3

you

take

credit

cards?

Ref 4

you

take

credit

cards?

Ref 5

you

take

credit

cards?

Output 0

Can

use

the

credit

card?

N-grams

Can	use	the	credit	card?
Can			credit	card?
			credit card?

Output 1

use

credit

card

can

N-grams

use	credit	card	can	?
	credit

Output 2

Use

credit

card?

N-grams

Use	credit	card?
	credit	card?
	credit card?

Output 3

Can

use

credit

card?

N-grams

Can	use	credit	card?
Can		credit	card?
		credit card?

Output 4

Can

use

the

credit

card?

N-grams

Can	use	the	credit	card?
Can			credit	card?
			credit card?

Sentence 458) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�I�l

��

�x��

�C

Ref 0

I'm

having

difficulty

breathing.

Ref 1

having

difficulty

breathing.

Ref 2

I'm

having

trouble

breathing.

Ref 3

can't

breathe.

Ref 4

I'm

having

difficulty

breathing.

Ref 5

I'm

having

difficulty

breathing.

Output 0

The

breath

very

difficult.

N-grams

The

breath

very

difficult.

Output 1

very

difficult

the

breath

N-grams

very

difficult

the

breath

Output 2

Breathing

very

difficult.

N-grams

Breathing

very

difficult.

Output 3

The

breath

very

difficult.

N-grams

The

breath

very

difficult.

Output 4

The

breath

very

difficult.

N-grams

The

breath

very

difficult.

Sentence 459) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.375/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�n

��

�w��U

��

�H

Ref 0

you

need

helmet?

Ref 1

you

require

helmet?

Ref 2

you

want

helmet?

Ref 3

you

require

protective

head

gear?

Ref 4

you

need

helmet?

Ref 5

you

need

helmet?

Output 0

You

must

wear

helmet?

N-grams

You	must	wear	a	helmet?
			a	helmet?
			a helmet?

Output 1

must

wear

helmet

safety

N-grams

must	wear	a	helmet	safety	?
		a

Output 2

You

must

wear

helmet?

N-grams

You	must	wear	a	helmet?
			a	helmet?
			a helmet?

Output 3

Have

want

wear

safety

helmet?

N-grams

Have	to	want	to	wear	a	safety	helmet?
		want			a		helmet?

Output 4

Must

wear

the

safety

helmet?

N-grams

Must	wear	the	safety	helmet?
				helmet?

Sentence 460) BLEU: 0 (0.6364/0.1429/0/0) ; 0 (0.7059/0.125/0/0) ; 0 (0.6364/0.1429/0/0) ; 0 (0.375/0.04348/0/0) ; 0 (0.4783/0.09091/0/0)

Source

��

�U��

�O

�n��P

�C

��

�q

��

�G

�Q

��

�n��f

�n��

�C

��

�b

�X�o

�e

�T

�Q

��

�n��f

�C

Ref 0

All

right,

here's

your

boarding

pass.
Your

flight

today

will

departing

from

gate

twenty-five.
Please

the

gate

later

than

thirty

minutes

prior

departure.

Ref 1

Okay,

here

your

boarding.
Today,

your

flight

will

depart

from

gate

twenty-five.
Please

the

gate

least

thirty

minutes

prior

departure.

Ref 2

Okay,

this

your

boarding

pass.
Today,

your

flight

will

leaving

from

gate

twenty-five.
You

will

need

the

gate

not

later

than

half

hour

before

departure

time.

Ref 3

Okay,

this

your

boarding

pass.
Your

flight

today

will

leave

from

gate

twenty-five.
Please

arrive

the

gate

least

thirty

minutes

before

the

plane

takes

off.

Ref 4

Okay,

here's

your

boarding

pass.
Your

flight

today

will

leaving

from

gate

twenty-five.
Please

the

gate

later

than

thirty

minutes

before

departure.

Ref 5

Okay,

here's

your

boarding

pass.
Today's

flight

will

departing

from

gate

twenty-five.
Please

the

gate

later

than

thirty

minutes

prior

departure

time.

Output 0

Followed

the

boarding

pass.

the

25th

from

the

boarding

gate.

Please

minutes

before

departure

the

boarding

gate.

N-grams

Followed

the

boarding

pass.

the

25th

from

the

boarding

gate.

Please

minutes

before

departure

the

boarding

gate.

the

boarding

pass.

the

from

minutes

before

departure

boarding pass.

minutes before

before departure

Output 1

the

boarding

from

boarding

gate

please

minutes

before

departure

boarding

gate

N-grams

the

boarding

from

boarding

gate

please

minutes

before

departure

boarding

gate

the

boarding

from

gate

minutes

before

departure

gate

minutes before

before departure

Output 2

Followed

the

boarding

pass.

the

25th

from

the

boarding

gate.

Please

minutes

before

departure

the

boarding

gate.

N-grams

Followed

the

boarding

pass.

the

25th

from

the

boarding

gate.

Please

minutes

before

departure

the

boarding

gate.

the

boarding

pass.

the

from

minutes

before

departure

boarding pass.

minutes before

before departure

Output 3

Connecting

down

boarding

card.Please

get

board

from

the

��

No.25

boarding.

Please

boarding

for

minutes

before

setting

out.

N-grams

Connecting

down

boarding

card.Please

get

board

from

the

��

No.25

boarding.

Please

boarding

for

minutes

before

setting

out.

boarding

from

the

boarding.

minutes

before

minutes before

Output 4

the

boarding

card.

Please

from

two

ten

five

departure

gate

boardings.

Please

before

departure

three

ten

minutes

departure

gate.

N-grams

the

boarding

card.

Please

from

two

ten

five

departure

gate

boardings.

Please

before

departure

three

ten

minutes

departure

gate.

the

boarding

from

departure

gate

before

minutes

before departure

to departure

Sentence 461) BLEU: 0 (0.4286/0.1667/0/0) ; 0 (0.5/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�h

�C

�Q

��

�A�ȥx

�C

Ref 0

Please

over

counter

seventy.

Ref 1

counter

number

seventy,

please.

Ref 2

Please

make

your

way

over

desk

seventy.

Ref 3

Please

walk

over

counter

seventy.

Ref 4

Please

move

counter

seventy.

Ref 5

Please

over

counter

number

seventy.

Output 0

Please

seven

tenth

service

desk.

N-grams

Please	go	to	seven	tenth	service	desk.
Please	go	to
Please go

Output 1

please

desk

N-grams

please	go	desk	.
	go	desk

Output 2

Please

Desk

No.

70.

N-grams

Please	go	Desk	No.	70.
Please	go
Please go

Output 3

Please

No.70

information

desk.

N-grams

Please	No.70	information	desk.
Please

Output 4

Please

seven

tenth

service

desk.

N-grams

Please	go	to	seven	tenth	service	desk.
Please	go	to
Please go

Sentence 462) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.4/0.25/0/0) ; 0.2985 (0.4444/0.375/0.2857/0.1667) ; 0 (0.2857/0.1667/0/0) ; 0 (0.2/0/0/0)

Source

�а�

�~�ⶡ

�b

��

�H

Ref 0

Where

the

restroom?

Ref 1

Where

the

bathroom?

Ref 2

Where

the

toilet?

Ref 3

Where

the

public

toilet?

Ref 4

Where's

the

restroom?

Ref 5

Where's

the

bathroom?

Output 0

Excuse

me,

where

the

bathroom?

N-grams

Excuse	me,	where	is	the	bathroom?
			is	the	bathroom?
			is the
			is the bathroom?
				the bathroom?

Output 1

ask

where

the

N-grams

ask	where	is	the	?
		is	the
		is the

Output 2

would

ask

Where

the

restroom?

N-grams

I	would	like	to	ask	Where	is	the	restroom?
					Where	is	the	restroom?
					Where is		the restroom?
					Where is the
					Where is the restroom?
						is the
						is the restroom?

Output 3

Excuse

me,

where

the

bathroom

N-grams

Excuse	me,	where	is	the	bathroom	?
			is	the
			is the

Output 4

Ask

the

washroom

where?

N-grams

Ask	the	washroom	in	where?
	the

Sentence 463) BLEU: 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.4/0/0/0)

Source

�o��

�b

��

�ײz

�H

Ref 0

Where

can

get

this

fixed?

Ref 1

Where

could

have

this

repaired?

Ref 2

Where

can

have

this

repaired?

Ref 3

Where

can

get

this

fixed?

Ref 4

Where

can

have

this

fixed?

Ref 5

Where

can

get

this

repaired?

Output 0

Where

this

repair?

N-grams

Where	is	this	repair?
Where		this

Output 1

where

this

repair

does

N-grams

where	this	repair	does	?
	this

Output 2

Where

this

repair?

N-grams

Where	is	this	repair?
Where		this

Output 3

Where

does

this

fix?

N-grams

Where	does	this	fix?
Where		this

Output 4

Where

this

does

repair?

N-grams

Where	this	does	in	repair?
Where	this

Sentence 464) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�ϩR

�I

Ref 0

Help.

Ref 1

Help

me.

Ref 2

Can

anybody

help?

Ref 3

need

assistance.

Ref 4

Help.

Ref 5

Please,

help.

Output 0

Save

life!

N-grams

Save

life!

Output 1

help

N-grams

help

Output 2

Help!

N-grams

Help!

Output 3

Help!

N-grams

Help!

Output 4

Save

life!

N-grams

Save

life!

Sentence 465) BLEU: 0 (1/1/1/0) ; 0 (0.25/0/0/0) ; 0 (1/1/1/0) ; 0 (1/1/1/0) ; 0 (1/1/1/0)

Source

��

�O

�P��T

�C

Ref 0

It's	Wednesday.

Ref 1

Wednesday.

Ref 2

Today

Wednesday.

Ref 3

It's	Wednesday.

Ref 4

Today's

Wednesday.

Ref 5

It's	Wednesday.

Output 0

Today

Wednesday.

N-grams

Today	is	Wednesday.
Today	is	Wednesday.
Today is
Today is Wednesday.
	is Wednesday.

Output 1

today

wednesday

N-grams

today	is	wednesday	.
	is

Output 2

Today

Wednesday.

N-grams

Today	is	Wednesday.
Today	is	Wednesday.
Today is
Today is Wednesday.
	is Wednesday.

Output 3

Today

Wednesday.

N-grams

Today	is	Wednesday.
Today	is	Wednesday.
Today is
Today is Wednesday.
	is Wednesday.

Output 4

Today

Wednesday.

N-grams

Today	is	Wednesday.
Today	is	Wednesday.
Today is
Today is Wednesday.
	is Wednesday.

Sentence 466) BLEU: 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2/0/0/0)

Source

�z

��

�H

Ref 0

May

help

you,

sir?

Ref 1

Could

assist

you,

sir?

Ref 2

you

require

assistance,

sir?

Ref 3

Can

assist

you,

sir?

Ref 4

Can

help

you,

sir?

Ref 5

How

may

help

you,

sir?

Output 0

You

have

what

for

you?

N-grams

You	have	what	I	do	for	you?
			I

Output 1

you

have

what

matter

N-grams

you	have	what	do	matter	?
you

Output 2

You

have

what

for

you?

N-grams

You	have	what	I	do	for	you?
			I

Output 3

What

matter

you

have?

N-grams

What	matter	do	you	have?
			you

Output 4

What

matter

you

have?

N-grams

What	matter	do	you	have?
			you

Sentence 467) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.6/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (1/0.5/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�Q

�n

�P�_��

�C

Ref 0

want

medicine

for

cold.

Ref 1

would

some

cold

medicine.

Ref 2

would

some

flu

medicine.

Ref 3

would

cold

medicine.

Ref 4

want

cold

medicine.

Ref 5

want

some

cold

medicine.

Output 0

I'd

cold

medicine.

N-grams

I'd	like	cold	medicine.
	like	cold	medicine.
	like cold
	like cold medicine.
		cold medicine.

Output 1

cold

medicine

want

N-grams

i	cold	medicine	want	.
	cold	medicine	want

Output 2

I'd

cold

medicine.

N-grams

I'd	like	cold	medicine.
	like	cold	medicine.
	like cold
	like cold medicine.
		cold medicine.

Output 3

want

cold

medicine.

N-grams

I	want	a	cold	medicine.
I	want	a	cold	medicine.
I want			cold medicine.

Output 4

want

the

cold

remedy.

N-grams

I	want	the	cold	remedy.
I	want		cold
I want

Sentence 468) BLEU: 0 (0.4286/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.5/0/0/0)

Source

�i�H

��

�y��

��

�H

Ref 0

May

change

seat?

Ref 1

Can

change

seat?

Ref 2

Could

change

place?

Ref 3

Can

switch

seat?

Ref 4

May

change

seats?

Ref 5

May

move

different

seat?

Output 0

all

right

change

seat?

N-grams

Is	it	all	right	to	change	seat?
				to	change	seat?

Output 1

seat

N-grams

seat

Output 2

Can

exchange

seat?

N-grams

Can	exchange	seat?
Can		seat?

Output 3

all

right

change

seat?

N-grams

Is	it	all	right	to	change	seat?
				to	change	seat?

Output 4

May

trade

the

seat?

N-grams

May	trade	the	seat?
May			seat?

Sentence 469) BLEU: 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3/0/0/0) ; 0 (0.5556/0.125/0/0)

Source

�p�G

��

�Q

�h��

�C

Ref 0

cannot

change

it,

then

please

cancel

it.

Ref 1

can't

change

it,

then

cancel

it,

please.

Ref 2

can't

swap

it,

then

please

cancel

it.

Ref 3

can't

exchange

it,

then

please

void

it.

Ref 4

can't

changed,

then

please

cancel

it.

Ref 5

unable

change

it,

then

please

cancel

it.

Output 0

Can

changed

want

refund.

N-grams

Can	be	changed	if	I	want	a	refund.
	be			I

Output 1

can

want

N-grams

can

want

Output 2

Can

changed

want

refund.

N-grams

Can	be	changed	if	I	want	a	refund.
	be			I

Output 3

the

words

can't

changing

think

dishonor

bill.

N-grams

If	the	words	can't	changing	I	think	a	dishonor	bill.
If			can't		I

Output 4

cannot

change

want

return

ticket.

N-grams

If	cannot	change	I	want	to	return	a	ticket.
If	cannot	change	I		to
	cannot change

Sentence 470) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0)

Source

�Y

�h

�C

Ref 0

I've

got

headache.

Ref 1

have

headache.

Ref 2

head

aches.

Ref 3

head

hurts.

Ref 4

have

got

headache.

Ref 5

I've

got

headache.

Output 0

Have

headache.

N-grams

Have	a	headache.
	a	headache.
	a headache.

Output 1

headache

N-grams

headache

Output 2

Headache.

N-grams

Headache.

Output 3

Have

headache.

N-grams

Have	a	headache.
	a	headache.
	a headache.

Output 4

Headache.

N-grams

Headache.

Sentence 471) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�l��

�C

Ref 0

Can

have

commemorative

postage

stamps?

Ref 1

Can

have

some

commemorative

postage

stamps?

Ref 2

May

have

some

memorial

stamps?

Ref 3

May

purchase

some

commemorative

postage

stamps?

Ref 4

Can

get

commemorative

postage

stamps?

Ref 5

I'd

some

commemorative

postage

stamps,

please.

Output 0

Please

give

stamps.

N-grams

Please

give

stamps.

Output 1

please

give

stamp

N-grams

please

give

stamp

Output 2

Please

give

stamps.

N-grams

Please

give

stamps.

Output 3

Please

celebrate

stamp

for

me.

N-grams

Please

celebrate

stamp

for

me.

Output 4

Please

give

the

commemorative

stamp.

N-grams

Please	give	me	the	commemorative	stamp.
				commemorative

Sentence 472) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.6/0.25/0/0)

Source

�z

��

�ؤo

�O

�h��

�H

Ref 0

What

size

are

you?

Ref 1

What

your

size?

Ref 2

What

size

you

wear?

Ref 3

What

size

you

take?

Ref 4

What's

your

size?

Ref 5

What

size

are

you?

Output 0

How

much

your

size?

N-grams

How	much	is	your	size?
		is	your	size?
		is your
		is your size?
			your size?

Output 1

your

size

how

N-grams

your	size	how	?
your	size

Output 2

Your

size?

N-grams

Your	size?
	size?

Output 3

How

much

your

size

N-grams

How	much	is	your	size	?
		is	your	size
		is your

Output 4

How

many

are

your

size?

N-grams

How	many	are	your	size?
		are	your	size?
			your size?

Sentence 473) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�{�b

��

�Y��

��

�\�]

��

�H

Ref 0

Are

there

any

restaurants

open

now?

Ref 1

Are

there

any

restaurants

open

this

time?

Ref 2

What

restaurants

are

open

now?

Ref 3

Are

any

eating

establishments

open

this

moment?

Ref 4

Are

any

restaurants

open

now?

Ref 5

Are

there

any

restaurants

open

now?

Output 0

Can

now

have

the

restaurant

eat

it?

N-grams

Can

now

have

the

restaurant

eat

it?

Output 1

can

now

have

restaurant

eat

N-grams

can

now

have

restaurant

eat

Output 2

Can

now

have

the

restaurant

eat

it?

N-grams

Can

now

have

the

restaurant

eat

it?

Output 3

Have

now

restaurant

edibling

rice?

N-grams

Have

now

restaurant

edibling

rice?

Output 4

Now

has

restaurant

which

can

eat

meal?

N-grams

Now

has

restaurant

which

can

eat

meal?

Sentence 474) BLEU: 0 (0.125/0/0/0) ; 0 (0/0/0/0) ; 0 (0.125/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�I��

��

�C

Ref 0

Can

have

receipt?

Ref 1

Could

have

receipt?

Ref 2

May

have

the

receipt,

please?

Ref 3

Could

get

receipt?

Ref 4

Can

have

receipt?

Ref 5

May

have

receipt,

please?

Output 0

Please

give

single

dollar

water.

N-grams

Please	give	me	a	single	dollar	of	water.
			a

Output 1

please

give

water

exchange

N-grams

please

give

water

exchange

Output 2

Please

give

single

dollar

water.

N-grams

Please	give	me	a	single	dollar	of	water.
			a

Output 3

Please

exchange

water

list

for

me.

N-grams

Please

exchange

water

list

for

me.

Output 4

Please

give

the

exchange

memo.

N-grams

Please	give	me	the	exchange	memo.
			the

Sentence 475) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4/0/0/0) ; 0 (0.25/0/0/0)

Source

�n

�h��

�ɶ�

�H

Ref 0

How

long

does

take

get

there?

Ref 1

How

much

time

does

take

get

there?

Ref 2

How

much

time

does

take

arrive

there?

Ref 3

How

soon

before

arrive?

Ref 4

How

long

does

take

arrive

there?

Ref 5

How

long

does

take

get

there?

Output 0

How

long

will

take?

N-grams

How	long	will	it	take?
How	long		it
How long

Output 1

long

time

N-grams

long	time	?
long	time

Output 2

How

long

will

take?

N-grams

How	long	will	it	take?
How	long		it
How long

Output 3

Want

grow

time

more?

N-grams

Want	to	grow	time	more?
	to		time

Output 4

Must

the

long

time?

N-grams

Must	the	long	time?
		long

Sentence 476) BLEU: 0 (0.4/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5714/0/0/0)

Source

��

�z

�e

��

�C

Ref 0

will

explain

drawing

picture.

Ref 1

will

draw

picture

explain.

Ref 2

explain

will

draw

picture.

Ref 3

Let

show

you

with

illustration.

Ref 4

I'll

explain

drawing

picture.

Ref 5

will

explain

drawing

picture.

Output 0

I'll

give

you

that

drawing.

N-grams

I'll	give	you	that	drawing.
I'll		you

Output 1

give

you

draw

explanation

N-grams

i	give	you	draw	explanation	.
		you	draw

Output 2

I'll

give

you

that

drawing.

N-grams

I'll	give	you	that	drawing.
I'll		you

Output 3

draw

explanation

for

you.

N-grams

I	draw	explanation	for	you.
I	draw

Output 4

give

you

draw

the

explanation.

N-grams

I	give	you	to	draw	the	explanation.
I		you	to	draw

Sentence 477) BLEU: 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0)

Source

��

��}

�]

�C

Ref 0

Can

you

wrap

these

separately?

Ref 1

Could

you

wrap

these

separately?

Ref 2

Would

you

mind

packaging

these

separately?

Ref 3

Could

you

package

these

separately?

Ref 4

Would

you

wrap

these

separately?

Ref 5

Can

you

wrap

these

separate

packages?

Output 0

Please

separate

the

package.

N-grams

Please	separate	the	package.
	separate

Output 1

please

separate

package

N-grams

please	separate	package	.
	separate	package

Output 2

Please

separate

package.

N-grams

Please	separate	package.
	separate

Output 3

Please

separately

wrap.

N-grams

Please

separately

wrap.

Output 4

Please

separate

the

package.

N-grams

Please	separate	the	package.
	separate

Sentence 478) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0/0/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6667/0/0/0) ; 0 (0.3333/0/0/0)

Source

��S��

��y

��x

�H

Ref 0

you

have

any

Japanese

magazines?

Ref 1

Are

there

any

Japanese

magazines?

Ref 2

Have

you

got

any

magazines

from

Japan?

Ref 3

Are

there

any

magazines

from

Japan?

Ref 4

Have

you

any

Japanese

magazines?

Ref 5

you

have

any

magazines

Japanese?

Output 0

there

any

Japanese

magazines?

N-grams

Is	there	any	Japanese	magazines?
	there	any	Japanese	magazines?
	there any		Japanese magazines?
	there any Japanese
	there any Japanese magazines?
		any Japanese
		any Japanese magazines?

Output 1

japanese

magazine

N-grams

japanese

magazine

Output 2

there

any

Japanese

magazines?

N-grams

Is	there	any	Japanese	magazines?
	there	any	Japanese	magazines?
	there any		Japanese magazines?
	there any Japanese
	there any Japanese magazines?
		any Japanese
		any Japanese magazines?

Output 3

Have

Japanese

magazine?

N-grams

Have	Japanese	magazine?
Have	Japanese

Output 4

Has

Japanese

magazine?

N-grams

Has	Japanese	magazine?
	Japanese

Sentence 479) BLEU: 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.1111/0/0/0) ; 0 (0.1111/0/0/0)

Source

��

�@

�i

�h

��w��

��

�C

Ref 0

One

for

Madrid,

please.

Ref 1

Please,

one

for

Madrid.

Ref 2

One

for

Madrid,

please.

Ref 3

I'll

take

one

for

Madrid,

please.

Ref 4

One

for

Madrid,

please.

Ref 5

I'd

one

for

Madrid,

please.

Output 0

Please

give

ticket

Madrid.

N-grams

Please	give	me	a	ticket	to	Madrid.
						Madrid.

Output 1

please

give

ticket

madrid

N-grams

please

give

ticket

madrid

Output 2

Please

give

ticket

Madrid.

N-grams

Please	give	me	a	ticket	to	Madrid.
						Madrid.

Output 3

Please

give

ticket

that

goes

Madrid.

N-grams

Please	give	me	a	ticket	that	goes	to	Madrid.
								Madrid.

Output 4

Please

give

one

Madrid's

ticket.

N-grams

Please	give	me	one	to	go	to	Madrid's	ticket.
			one

Sentence 480) BLEU: 0 (0.2222/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.3333/0/0/0)

Source

�O

�B��

�e

��

§�~

�C

Ref 0

No,

this

souvenir

from

friend.

Ref 1

No,

this

souvenir

from

friend.

Ref 2

No,

this

keepsake

from

mate.

Ref 3

No,

this

souvenir

from

friend.

Ref 4

No,

this

keepsake

from

friend.

Ref 5

No,

this

souvenir

from

friend

mine.

Output 0

the

gift

that

the

friend

sends

me.

N-grams

It	is	the	gift	that	the	friend	sends	me.
	is					friend

Output 1

friend

the

N-grams

friend	me	is	the	.
friend		is

Output 2

Friend

sent

are

gifts.

N-grams

Friend

sent

are

gifts.

Output 3

the

gift

that

the

friend

sends

me.

N-grams

It	is	the	gift	that	the	friend	sends	me.
	is					friend

Output 4

the

friend

gives

present.

N-grams

Is	the	friend	gives	my	present.
		friend		my

Sentence 481) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

Let

think.

Ref 1

Allow

think.

Ref 2

need

time

mull

over.

Ref 3

Allow

reflect.

Ref 4

Let

think.

Ref 5

Let

think

about

it.

Output 0

Ah.

N-grams

Ah.

Output 1

N-grams

Output 2

Ah.

N-grams

Ah.

Output 3

H'm.

N-grams

H'm.

Output 4

N-grams

Sentence 482) BLEU: 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

ı�o

��

�C

Ref 0

don't

feel

good.

Ref 1

not

feel

well.

Ref 2

feel

ill.

Ref 3

feel

bad.

Ref 4

not

feel

good.

Ref 5

feel

unwell.

Output 0

Feel	uncomfortable.

N-grams

Feel	uncomfortable.

Output 1

feel

N-grams

feel	.
feel

Output 2

Feel	uncomfortable.

N-grams

Feel	uncomfortable.

Output 3

Feel

suffered.

N-grams

Feel

suffered.

Output 4

Thinks

uncomfortably.

N-grams

Thinks

uncomfortably.

Sentence 483) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0/0/0)

Source

��

�^

��

�H

Ref 0

What's

the

matter?

Ref 1

What

the

problem?

Ref 2

What's

the

problem?

Ref 3

What

the

matter?

Ref 4

What's

wrong?

Ref 5

What's

the

matter?

Output 0

What

the

row?

N-grams

What	is	the	row?
What	is	the
What is
What is the
	is the

Output 1

how

N-grams

how

Output 2

How's

going

on?

N-grams

How's

going

on?

Output 3

What

the

row?

N-grams

What	is	the	row?
What	is	the
What is
What is the
	is the

Output 4

How

matter?

N-grams

How	matter?
	matter?

Sentence 484) BLEU: 0 (0.1429/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1429/0/0/0)

Source

��

�T

�N��

�C

Ref 0

Five

tokens,

please.

Ref 1

Please,

five

tokens.

Ref 2

Five

coupons,

please.

Ref 3

I'll

take

five

tokens,

please.

Ref 4

Five

tokens,

please.

Ref 5

I'd

five

tokens,

please.

Output 0

Please

give

five

generation

coins.

N-grams

Please	give	me	five	generation	of	coins.
			five

Output 1

please

give

five

generation

N-grams

please	give	me	five	generation	.
			five

Output 2

Please

give

tokens.

N-grams

Please	give	me	5	tokens.
				tokens.

Output 3

Please

give

five

generation

currencies.

N-grams

Please	give	me	five	generation	currencies.
			five

Output 4

Please

give

five

generation

coins.

N-grams

Please	give	me	five	generation	of	coins.
			five

Sentence 485) BLEU: 0 (0.6667/0.4/0.25/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.25/0/0/0)

Source

��ۻ�B

�b

��

�H

Ref 0

Where

the

Lost

and

Found?

Ref 1

Where

the

Lost

and

Found

department?

Ref 2

Can

you

direct

the

Lost

and

Found

department?

Ref 3

Could

you

tell

where

the

Lost

and

Found

located?

Ref 4

Where's

the

Lost

and

Found?

Ref 5

Where

the

Lost

and

Found?

Output 0

Where

the

lost

and

found?

N-grams

Where	is	the	lost	and	found?
Where	is	the		and
Where is
Where is the
	is the

Output 1

lost

and

found

the

where

N-grams

lost	and	found	the	where	?
	and		the	where

Output 2

Lost

and

Found

the

Where?

N-grams

Lost	and	Found	in	the	Where?
Lost	and	Found		the
Lost and
Lost and Found
	and Found

Output 3

Where

the

lost

and

found

N-grams

Where	is	the	lost	and	found	?
Where	is	the		and
Where is
Where is the
	is the

Output 4

Where

does

lost-and-found

occupy?

N-grams

Where	does	lost-and-found	occupy?
Where

Sentence 486) BLEU: 0 (0.75/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.75/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

�զ綡

�b

��

�H

Ref 0

Where

the

changing

room?

Ref 1

Where

room

for

changing?

Ref 2

Where

the

locker

room?

Ref 3

Could

you

tell

where

the

dressing

room

located?

Ref 4

Where's

the

changing

room?

Ref 5

Where

can

find

the

changing

room?

Output 0

Where

the

fitting

room?

N-grams

Where	the	fitting	room?
Where	the		room?

Output 1

where

the

N-grams

where	the	?
where	the
where the

Output 2

Where

the

fitting

room?

N-grams

Where	the	fitting	room?
Where	the		room?

Output 3

Try

dress

where?

N-grams

Try

dress

where?

Output 4

Tries

between

the

clothes

where?

N-grams

Tries	between	the	clothes	in	where?
		the

Sentence 487) BLEU: 0.4111 (0.6/0.4444/0.375/0.2857) ; 0 (0.2857/0/0/0) ; 0.4273 (0.7/0.4444/0.375/0.2857) ; 0.1632 (0.5789/0.1667/0.1176/0.0625) ; 0 (0.1818/0/0/0)

Source

��

�n

�w�q

��

�W�t

��

��d

��

�C

Ref 0

want

reserve

tomorrow's

Tosca.

Ref 1

would

book

Tosca

for

tomorrow.

Ref 2

May

book

for

the

Tosca

for

tomorrow?

Ref 3

would

make

reservations

for

tomorrow's

performance

Tosca.

Ref 4

I'd

reserve

tomorrow's

Tosca.

Ref 5

want

reserve

tomorrow's

performance

Tosca.

Output 0

Tomorrow

would

book

the

ticket

tosca

staged.

N-grams

Tomorrow	I	would	like	to	book	the	ticket	tosca	staged.
	I	would	like	to	book	the
	I would		like to
	I would like			to book
	I would like to
		would like
		would like to
		would like to book
			like to book

Output 1

tomorrow

the

ticket

will

N-grams

tomorrow	i	to	the	ticket	will	.
		to	the

Output 2

Tomorrow

would

book

the

ticket

Tosca

staged.

N-grams

Tomorrow	I	would	like	to	book	the	ticket	Tosca	staged.
	I	would	like	to	book	the		Tosca
	I would		like to
	I would like			to book
	I would like to
		would like
		would like to
		would like to book
			like to book

Output 3

want

reserve

will

present

public

tomorrow

the

ticket

the

card

Tuo

Si.

N-grams

want

reserve

will

present

public

tomorrow

the

ticket

the

card

Tuo

Si.

want

reserve

the

I want

to reserve

I want to

I want to reserve

want to

want to reserve

Output 4

Tomorrow

must

order

the

request

Sika

ticket

which

will

perform.

N-grams

Tomorrow	I	must	order	the	request	Sika	ticket	which	will	perform.
	I			the

Sentence 488) BLEU: 0 (0.1429/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.1429/0/0/0)

Source

�G

��

�U

�F��

�C

Ref 0

can't

keep

anything

stomach.

Ref 1

cannot

keep

anything

down.

Ref 2

can't

keep

anything

down.

Ref 3

I'm

having

trouble

keeping

anything

down.

Ref 4

can't

keep

anything

stomach.

Ref 5

I'm

not

able

keep

anything

stomach.

Output 0

the

stomach

cannot

have

the

thing.

N-grams

In	the	stomach	cannot	have	the	thing.
			cannot

Output 1

stomach

thing

N-grams

in	stomach	thing	.
in

Output 2

Stomach裝不下things.

N-grams

Stomach裝不下things.

Output 3

stomach

pack

not

descend

thing.

N-grams

In	stomach	pack	not	descend	thing.
			not

Output 4

the

stomach

cannot

have

the

thing.

N-grams

In	the	stomach	cannot	have	the	thing.
			cannot